Looking for a Crawler

[Nadir]

Hello,
I'm looking for a simple (free) crawler that will allow me to specify the user-agent. Basically, I just need something that will retrieve urls and title tags.

Thanks for your help,
Nadir

[ssgupta]

Try: [cs.ioc.ee...]

[Nadir]

thank you!