Ask Jeeves/Teoma oddities

odd IPs and reverse DNS

[incrediBILL]

Normally I see Ask with something like the following:

65.214.45.119
"Mozilla/5.0 (compatible; Ask Jeeves/Teoma; +http://about.ask.com/en/docs/about/webmasters.shtml)"

Which validates with my full trip DNS checking because it has both "crawler" and ".ask.com" in the results such as 'crawler4010.ask.com.'.

However, lately I'm getting some rather odd hits that don't validate.

66.235.112.5 -> tn-fw.ask.com.
"Mozilla/5.0 (compatible; Ask Jeeves/Teoma; +http://about.ask.com/en/docs/about/webmasters.shtml)"

206.80.1.253 -> g2spf.jeeves.ask.info.
"Mozilla/5.0 (compatible; Ask Jeeves/Teoma; +http://about.ask.com/en/docs/about/webmasters.shtml)"

Both are definitely from Ask, but it's really hard to validate reliably if they're just changing the information randomly.

Anyone else seeing this?

[wilderness]

Bill,
I get a variety of IP's from Jeeves.
One even includes Linux in the UA.

Some of these ranges, I have denied.
Their 65.214. range, I don't even bother watching.

For the amount of crawling they do, the referrals hardly warrant the bandwidth.

MSN and Yahoo have become much bigger pains than Jeeves.

[blend27]

The Linux one also acts as a full/real browser request, it downloads images as well. It was first comming from Ireland if I remember it correctly.

[incrediBILL]

The Linux one is probably making screen shots for their site as I've tracked that activity.

[mrjones]

All of a sudden i have seen a beehive of activity from Ask lately.
Normally takes a page or two,now it is starting to go deep.

anyway heres mine

egspd42052.ask.com
/robots.txt
Http Code: 200Date: Apr 23 22:46:19Http Version: HTTP/1.0Size in Bytes: 701
Referer: -
Agent: Mozilla/2.0 (compatible; Ask Jeeves/Teoma; +http://about.ask.com/en/docs/about/webmasters.shtml)

[mrjones]

Holy Batman BIll My agent is mozilla/2.0 is good or bad i think it might be scrape?
Who crawls with moz/2.0?
Help advice

[wilderness]

Who crawls with moz/2.0?

Jeeves and some others.

[mrjones]

Thanks Mate here i was snuged up that my rDNS plus the whitelist Bill gave us was working and just looking back at this thread today I realised the moz agents were different..thus started thinking was it cloaked or something.
I have done some snoopin and all seems ok.