Hello just got visited by a new spider, here are the details:
originating ip: 213.173.191.108
fetches robots.txt
up to 4 requests per second, fetches only .html, .shtml, and .php, no images, no stylesheets
Looks like a 'site-download' script to me.
Any ideas?
Skirril