Page is a not externally linkable
- Search Engines
-- Search Engine Spider and User Agent Identification
---- Revised Spider IPs and Other Details

dstiles - 9:33 pm on Feb 11, 2013 (gmt 0)


I thought fairpoint was broadband?

I have 178.32.0.0/15 blocked as being OVH assigned to various EU countries.

208.128.0.0 - 208.167.191.255 I have blocked as being essentially sub-lets of savvis.

Yandex bot has many very small IP ranges.

Thread source:: http://www.webmasterworld.com/search_engine_spiders/4544452.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com