Welcome to WebmasterWorld Guest from 54.146.217.179

Forum Moderators: phranque

Message Too Old, No Replies

Looking for a Crawler

     
6:04 pm on Jan 19, 2007 (gmt 0)

New User

10+ Year Member

joined:Jan 10, 2006
posts:20
votes: 0


Hello,
I'm looking for a simple (free) crawler that will allow me to specify the user-agent. Basically, I just need something that will retrieve urls and title tags.

Thanks for your help,
Nadir

1:36 pm on Jan 21, 2007 (gmt 0)

New User

10+ Year Member

joined:Feb 5, 2004
posts:9
votes: 0


Try: [cs.ioc.ee...]
9:43 am on Jan 22, 2007 (gmt 0)

New User

10+ Year Member

joined:Jan 10, 2006
posts:20
votes: 0


thank you!