Speedy Spider

New UA

[keyplyr]

New UA: Mozilla/5.0 (compatible; Speedy Spider; http://www.entireweb.com/about/search_tech/speedy_spider/)

Old UA (still in use): Speedy Spider (http://www.entireweb.com/about/search_tech/speedy_spider/)

IP range: 88.131.106.0/26
rDNS: c**.entireweb.com

[tangor]

Any problems? So far Speedy has honored my disallow (I whitelist).

[keyplyr]

No problems, just a FYI for whitelisting, etc.

[tangor]

Thanks! I do love those bots that honor the spirit of robots.txt!