Alltheweb spider

[stn24]

I just got hit by: 209.67.247.232 - user agent: Mozilla/4.0 (compatible; MSIE 4.01; Win32).

DNS resolves to : 209.67.247.232 Host: rdcrawler3.uswal.alltheweb.com
Alternate address: 50.51.50.46
Alternate address: 50.52.55.46
Alternate address: 54.55.46.50
Alternate address: 48.57.46.105
Alternate address: 110.45.97.100
Alternate address: 100.114.46.97
Aliases: 232.247.67.209.in-addr.arpa

Thank god for straight ip cloaking

I looked through my files and this is what the UA used to look like: rdcrawler3.uswal.alltheweb.com

[BoneHeadicus]

Yes yes. They are getting sneaky.

I would suggest keeping a very close eye on Fast....there might be more like that.

[mivox]

in-addr.arpa? Is there a specific IP range of in-addr.arpa that's spiders, or are they ALL spiders... I get regular hits from in-addr.arpa machines, and I could never figure them out.

[mivox]

Gosh! My first duplicate post!

[stn24]

I really don't know, here is what I've got :
208.51.0.79
209.67.247.204
209.67.247.203
209.67.247.201
209.67.247.157
209.67.247.156
209.67.247.155
209.202.148.41
209.202.148.36
209.202.148.35
All these resolve to in-addr.arpa