Is this really ia archiver?

What is the true IA user agent?

[bouncybunny]

This is trawling dozens of pages on my site. Is this IP really from archive.org?

64.208.172.* - - [11/Jun/2007:21:51:07 -0400] "GET /directory/index.html HTTP/1.0" 301 40329 "-" "ia_archiver"

[thetrasher]

Yes and no.

No, this IP is not from Internet Archive/archive.org. This IP range belongs to Alexa. A reverse DNS lookup should result in xcrawl**.alexa.com, but rDNS seems to be misconfigured. Forward DNS works; i.e. xcrawl28 is in 64.208.172.0/24.

Yes, this is the real ia_archiver.

[bouncybunny]

Masterful. Thank you.

[wilderness]

These folks crawl from more hidden IP's than most everybody.

64.213.203.145 - - [14/Jun/2007:11:12:01 -0500] "GET /robots.txt HTTP/1.0" 403 - "-" "ia_archiver"