Forum Moderators: phranque
/robots.txt
Http Code: 403 Date: Sep 14 02:51:40 Http Version: HTTP/1.1 Size in Bytes: -
Referer: -
Agent: Java/1.6.0-beta2
¦
¦
¦
/
Http Code: 200 Date: Sep 14 02:51:40 Http Version: HTTP/1.1 Size in Bytes: 8369
Referer: -
Agent: Mozilla/5.0 (compatible; MSIE 6.0; Windows NT 5.0)
¦
¦
¦
/sitemap.html
Http Code: 200 Date: Sep 14 02:51:41 Http Version: HTTP/1.1 Size in Bytes: 8423
Referer: -
Agent: Mozilla/5.0 (compatible; MSIE 6.0; Windows NT 5.0)
¦
¦
¦
/quality-sites-directories.html
Http Code: 200 Date: Sep 14 02:51:42 Http Version: HTTP/1.1 Size in Bytes: 4980
Referer: -
Agent: Mozilla/5.0 (compatible; MSIE 6.0; Windows NT 5.0)
[edited by: jatar_k at 5:39 pm (utc) on Sep. 14, 2006]
[edit reason] no specific IPs thanks [/edit]
key_master's bad-bot PERL script (or one of the several modified/enhanced versions) and the runaway 'bot PHP script by xlcus/alexk, both posted on WebmasterWorld, might help you avoid this kind of problem in the future.
Jim