Forum Moderators: phranque

Message Too Old, No Replies

Site Ripping Tool

         

brass monkey

3:38 pm on Jul 26, 2004 (gmt 0)

10+ Year Member



Hi all,

I am looking for some software that functions as a site ripping tool. Any suggestions are greatly appreciated...

BrAsS_mOnKeY

zulufox

3:41 pm on Jul 26, 2004 (gmt 0)

10+ Year Member



I think firefox has an extension called spiderzilla... should do what you want

Jon_King

3:43 pm on Jul 26, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Teleport works well.

brass monkey

3:48 pm on Jul 26, 2004 (gmt 0)

10+ Year Member



Thanks for the input...

keyplyr

12:35 am on Jul 27, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Will this UA show as SpiderZilla in access logs?

Palehorse

6:27 pm on Jul 28, 2004 (gmt 0)

10+ Year Member



In unix wget does a great job of doing a total mirror...

isitreal

2:04 am on Jul 29, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



There's apparently a windows port of wget [interlog.com] too.

dillonstars

1:44 pm on Aug 1, 2004 (gmt 0)

10+ Year Member



I've used Spidersoft WebZip for this for a long time to great effect.

bull

6:57 am on Aug 2, 2004 (gmt 0)

10+ Year Member



Will this UA show as SpiderZilla in access logs?

Spiderzilla is a UI for HTTrack 3.0. It will take over the Browser's UA and NOT look for robots.txt
It will make HEAD requests on filetypes that are not html, htm, gif, ... (all the web stuff).

amznVibe

7:02 am on Aug 2, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Be aware if this is not for your own site or client, you will make another webmaster very upset.

(and you will stick out in their logs)

bull

7:25 am on Aug 2, 2004 (gmt 0)

10+ Year Member



and your ISP probably will get 403ed

ncw164x

7:31 am on Aug 2, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



HTTrack

shinyblue

9:53 am on Aug 2, 2004 (gmt 0)

10+ Year Member



WebReaper is free.
BlackWidow is not.