homepage Welcome to WebmasterWorld Guest from 54.196.105.130
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Home / Forums Index / Microsoft / Bing Search Engine News
Forum Library, Charter, Moderators: mack

Bing Search Engine News Forum

    
MSN Spider ip List?
Brett_Tabke




msg:4051361
 1:02 pm on Dec 30, 2009 (gmt 0)

Anyone have an uptodate list of MSN bot spider ips?

 

dstiles




msg:4051706
 10:12 pm on Dec 30, 2009 (gmt 0)

I ran rDNS checks in bulk a couple of weeks ago and came up with the following. There are a few blank rDNS entries of one or two IPs within some (most?) ranges which I included to reduce the number of ranges I had to use in the software.

NOTE: These are only for an rDNS that includes msnbot.

65.54.164.36 - 65.54.135.0
65.54.165.7
65.54.165.32 - 65.54.165.74
65.54.165.97 - 65.54.165.111
65.55.2.134 - 65.55.2.248
65.55.3.134 - 65.55.3.253
65.55.4.7 - 65.55.4.35
65.55.4.50 - 65.55.4.236
65.55.37.133 - 65.55.37.247
65.55.51.6 - 65.55.51.120
65.55.51.138 - 65.55.51.252
65.55.104.10 - 65.55.110.225
65.55.115.135 - 65.55.115.230
65.55.165.11 - 65.55.165.130
65.55.207.11 - 65.55.207.154
65.55.217.16
65.55.217.69
65.55.217.145
65.55.217.161
65.55.217.167
65.55.219.34
65.55.219.135 - 65.55.220.230
65.55.230.11 - 65.55.232.255
65.55.235.138 - 65.55.235.143
65.55.235.158 - 65.55.235.165
65.55.235.170
65.55.235.192 - 65.55.235.202
65.55.235.205
65.55.246.30 - 65.55.246.129
207.46.98.0 - 207.46.98.2
207.46.98.5 - 207.46.98.255
207.46.126.10 - 207.46.126.247
207.46.127.10 - 207.46.127.247

Full MSN ranges that may or may not include other semi-bot, translate, proxies etc (excluding tide) as I have them:

64.4.0.0 - 64.4.63.255
65.52.0.0 - 65.55.255.255
94.245.64.0 - 94.245.127.255
205.248.0.0 - 205.248.255.255
207.46.0.0 - 207.46.255.255
207.68.128.0 - 207.68.207.255
209.240.192.0 - 209.240.223.255

Receptional




msg:4052002
 12:23 pm on Dec 31, 2009 (gmt 0)

Gotta love Webmasterworld!

Thanks for sharing dstiles.

Brett_Tabke




msg:4052185
 5:35 pm on Dec 31, 2009 (gmt 0)

awesome - thanks dude!

dstiles




msg:4052357
 9:57 pm on Dec 31, 2009 (gmt 0)

You're welcome! :)

I'm gradually building up a new db of good (or at least acceptable) bot IPs 'cause I can't rDNS them on the fly. So far google seems most reasonable in allocation: six C's in two clumps. Yandex is definitely the worst - about 150 IPs scattered two or three to each C range; and they still send round oddly titled rDNS with their standard bot.

dstiles




msg:4060381
 2:26 am on Jan 14, 2010 (gmt 0)

Update on the 207 ranges. Not sure if this was me being sloppy or if some of them are new.

Note: some IP sets are msnbot-(ip).search.msn.com and others are msnbot-(ip).msn.com. No idea why but it seems as though the ones I missed before are of the latter persuasion (which may be why I missed them).

207.46.98.0-207.46.98.255
207.46.99.0-207.46.99.255
207.46.102.129
207.46.126.10-207.46.126.247
207.46.127.10-207.46.127.247
207.46.199.161-207.46.199.254

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Microsoft / Bing Search Engine News
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved