Page is a not externally linkable
- Search Engines
-- Search Engine Spider and User Agent Identification
---- Definitive Sources of IP Lists


incrediBILL - 8:03 am on Nov 28, 2012 (gmt 0)


Been looking for some definitive IP list sources maintained by the owner and not guessed at by 3rd parties by observation and a couple I came across are:

Microsoft's Azure Cloud Services provides an XML file:
[microsoft.com...]

Google provides a simple list in DNS from the command line:
nslookup -type=TXT _netblocks.google.com


Which returns:
_netblocks.google.com text = "v=spf1 ip4:216.239.32.0/19 ip4:64.233.160.0/19 ip4:66.249.80.0/20 ip4:72.14.192.0/18 ip4:209.85.128.0/17 ip4:66.102.0.0/20 ip4:74.125.0.0/16 ip4:64.18.0.0/20 ip4:207.126.144.0/20 ip4:173.194.0.0/16 ?all"


Anyone else got any direct IP list sources like these for Yahoo, Bing, etc.?


Thread source:: http://www.webmasterworld.com/search_engine_spiders/4523127.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com