newskies.net

Bad bot?

[dorward]

Any ideas what this is?

It ignores robots.txt, claims to be MSIE 6, doesn't send referrer information, and goes after some really odd URIs.

80.247.141.168 - - [05/Aug/2003:01:48:57 +0100] "GET /contact/#http HTTP/1.1" 200 7298 "-" "Mozilla/4.0 (compatible; MSIE 6.0; Windows 98)" 0 david.us-lot.org
80.247.141.168 - - [05/Aug/2003:01:48:59 +0100] "GET /contact/#im HTTP/1.1" 200 7298 "-" "Mozilla/4.0 (compatible; MSIE 6.0; Windows 98)" 0 david.us-lot.org
80.247.141.168 - - [05/Aug/2003:01:58:59 +0100] "GET /&prev=/search%3Fq%3DDorward%26hl%3Dde%26lr%3D%26ie%3DUTF-8 HTTP/1.1" 404 3870 "-" "Mozilla/4.0 (compatible; MSIE 6.0; Windows 98)" 0 david.us-lot.org
80.247.141.168 - - [05/Aug/2003:05:30:59 +0100] "GET /contact/&prev=/search%3Fq%3DDorward%2B%2Be-mail%26hl%3Dde%26lr%3D%26ie%3DUTF-8 HTTP/1.1" 404 3870 "-" "Mozilla/4.0 (compatible; MSIE 6.0; Windows 98)" 0 david.us-lot.org
80.247.141.168 - - [05/Aug/2003:05:30:59 +0100] "GET /contact/ HTTP/1.1" 200 7298 "-" "Mozilla/4.0 (compatible; MSIE 6.0; Windows 98)" 0 david.us-lot.org

I've put a full listing of assults from the ip today at http://david.us-lot.org/tmp/spidy

[jdMorgan]

dorward,

Welcome to WebmasterWorld [webmasterworld.com]!

Looks to me like a broken 'bot from Nigeria, apparently trying to spider URLs it got from Google - see that "hr=" and "lr=" in the URLs? You'll see URLs like that if you go the second page of Google search results.

Block it if it's being a nuisance; Lot's of scams running out of that country.

Please do not post your URL here in the forums - See WebmasterWorld Terms of Service [webmasterworld.com].

HTH,
Jim

[dorward]

Thanks. Sorry about the URL, I was trying not to dump too much data in the forum. I won't do that in future.