Forum Moderators: open

Message Too Old, No Replies

Looking For A Tool...

         

spyder_tek

8:23 am on Feb 10, 2005 (gmt 0)

10+ Year Member



I'm looking for a free online tool that allows me to spider a specific url and then automatically follow each link on the page and generate a list of small snippets of each link's resulting content (or the title of each link's target).

Does anyone know where I can find something like this?

Thanks.

hakre

10:07 am on Feb 11, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



i would suggest to grab firefox and browse the extensions available. i guess there should be something like that. look out for website preview or something like that.

rocknbil

4:35 pm on Feb 11, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



The perl lwp module also does this, but you'd have to do some server-side programming.

(By the way if you use it as a website function, that's called "scraping," be cautious how you use it.)