Welcome to WebmasterWorld Guest from 54.211.136.250

Forum Moderators: Ocean10000 & incrediBILL

Message Too Old, No Replies

Cloaked robot from Ask.com

No robots.txt, requests and malformed URLs

   
2:50 am on Sep 27, 2006 (gmt 0)

WebmasterWorld Senior Member jdmorgan is a WebmasterWorld Top Contributor of All Time 10+ Year Member



Log sample:

65.214.45.100 - - [25/Sep/2006:21:21:37 -0400] "GET /mypage1.html%09 HTTP/1.0" 403 666 "-" "Mozilla/4.0 (compatible: MSIE 5.5; Windows NT 4.0)"

65.214.45.100 - - [26/Sep/2006:21:33:04 -0400] "GET /mypage2.html%09%20192.168.131.187 HTTP/1.0" 403 666 "-" "Mozilla/4.0 (compatible: MSIE 5.5; Windows NT 4.0)"

Reverse DNS points to crawler100.ask.com via UUNET.

I think they'd better get Jeeves back on retainer; Those URL-paths are malformed. The second one was /mypage2.html<tab><space>my site's IP address. Maybe this is intended as a 404-check, but that ain't the way to do it proper, guv'nah.

Very bad form on this one, gentlemen...

Jim

5:47 pm on Sep 27, 2006 (gmt 0)

WebmasterWorld Senior Member wilderness is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month



Jim,
I've been getting them for a while.

The majority of mine are pages and images.

The visits are not often and in most instances a single page, however I recall instances where it was multiple pages (with images).

10:59 pm on Sep 27, 2006 (gmt 0)

WebmasterWorld Senior Member keyplyr is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month



LOL - your forbidden page weighs 666.
11:41 pm on Sep 27, 2006 (gmt 0)

WebmasterWorld Senior Member jdmorgan is a WebmasterWorld Top Contributor of All Time 10+ Year Member



Yes, intentional... :)

Jim

6:25 am on Oct 9, 2006 (gmt 0)

10+ Year Member



add IP range: 65.119.214.*

with UAs
Wget/1.8.1
or
Mozilla/4.0 (compatible; MSIE 5.5; Windows NT 4.0)