Aug. 18th, same IP and UA:
69.58.178.59
Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.1.3; ips-agent) Gecko/20090824 Fedora/1.0.7-1.1.fc4 Firefox/3.5.3
robots.txt? Yes
July 25th, next-door IP and same not-okay UA attribute:
69.58.178.58
BlackBerry9000/4.6.0.167 Profile/MIDP-2.0 Configuration/CLDC-1.1 VendorID/102 ips-agent
robots.txt? Yes
FWIW: Multiple prior years, across multiple sites, none with ecommerce or https --
Some bare IPS:
69.36.158.39
69.36.158.66
69.58.178.39
69.58.178.40
69.58.178.58
Some by Host:
crawl3.pub.colo-fo.brn1.verisign.com
crawl31.pub.colo.fo.brn1.verisign.com
ips-crawl2.colo-fo.ilg1.verisign.com
ips-crawl3.colo-fo.ilg1.verisign.com
ips-crawl5.colo-fo.ilg1.verisign.com
ips-crawl8.colo-fo.ilg1.verisign.com
All always using:
Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.7.12; ips-agent) Gecko/20050922 Fedora/1.0.7-1.1.fc4 Firefox/1.0.7
robots.txt? Yes
Hmm. I always chalked 'em up to a Network Solutions thing, although the hits never coincided with services/renewals either before or after the corporate changes:
"(VeriSign still retains the registry business which had been originally created within Network Solutions prior to VeriSign's acquisition of the company.)" [
en.wikipedia.org...]
Actually, I have no clue why they're crawling.