Welcome to WebmasterWorld Guest from 54.166.117.130

Forum Moderators: mack

MSN Spider ip List?

   
1:02 pm on Dec 30, 2009 (gmt 0)

WebmasterWorld Administrator brett_tabke is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month



Anyone have an uptodate list of MSN bot spider ips?
10:12 pm on Dec 30, 2009 (gmt 0)

WebmasterWorld Senior Member dstiles is a WebmasterWorld Top Contributor of All Time 5+ Year Member



I ran rDNS checks in bulk a couple of weeks ago and came up with the following. There are a few blank rDNS entries of one or two IPs within some (most?) ranges which I included to reduce the number of ranges I had to use in the software.

NOTE: These are only for an rDNS that includes msnbot.

65.54.164.36 - 65.54.135.0
65.54.165.7
65.54.165.32 - 65.54.165.74
65.54.165.97 - 65.54.165.111
65.55.2.134 - 65.55.2.248
65.55.3.134 - 65.55.3.253
65.55.4.7 - 65.55.4.35
65.55.4.50 - 65.55.4.236
65.55.37.133 - 65.55.37.247
65.55.51.6 - 65.55.51.120
65.55.51.138 - 65.55.51.252
65.55.104.10 - 65.55.110.225
65.55.115.135 - 65.55.115.230
65.55.165.11 - 65.55.165.130
65.55.207.11 - 65.55.207.154
65.55.217.16
65.55.217.69
65.55.217.145
65.55.217.161
65.55.217.167
65.55.219.34
65.55.219.135 - 65.55.220.230
65.55.230.11 - 65.55.232.255
65.55.235.138 - 65.55.235.143
65.55.235.158 - 65.55.235.165
65.55.235.170
65.55.235.192 - 65.55.235.202
65.55.235.205
65.55.246.30 - 65.55.246.129
207.46.98.0 - 207.46.98.2
207.46.98.5 - 207.46.98.255
207.46.126.10 - 207.46.126.247
207.46.127.10 - 207.46.127.247

Full MSN ranges that may or may not include other semi-bot, translate, proxies etc (excluding tide) as I have them:

64.4.0.0 - 64.4.63.255
65.52.0.0 - 65.55.255.255
94.245.64.0 - 94.245.127.255
205.248.0.0 - 205.248.255.255
207.46.0.0 - 207.46.255.255
207.68.128.0 - 207.68.207.255
209.240.192.0 - 209.240.223.255

12:23 pm on Dec 31, 2009 (gmt 0)



Gotta love Webmasterworld!

Thanks for sharing dstiles.

5:35 pm on Dec 31, 2009 (gmt 0)

WebmasterWorld Administrator brett_tabke is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month



awesome - thanks dude!
9:57 pm on Dec 31, 2009 (gmt 0)

WebmasterWorld Senior Member dstiles is a WebmasterWorld Top Contributor of All Time 5+ Year Member



You're welcome! :)

I'm gradually building up a new db of good (or at least acceptable) bot IPs 'cause I can't rDNS them on the fly. So far google seems most reasonable in allocation: six C's in two clumps. Yandex is definitely the worst - about 150 IPs scattered two or three to each C range; and they still send round oddly titled rDNS with their standard bot.

2:26 am on Jan 14, 2010 (gmt 0)

WebmasterWorld Senior Member dstiles is a WebmasterWorld Top Contributor of All Time 5+ Year Member



Update on the 207 ranges. Not sure if this was me being sloppy or if some of them are new.

Note: some IP sets are msnbot-(ip).search.msn.com and others are msnbot-(ip).msn.com. No idea why but it seems as though the ones I missed before are of the latter persuasion (which may be why I missed them).

207.46.98.0-207.46.98.255
207.46.99.0-207.46.99.255
207.46.102.129
207.46.126.10-207.46.126.247
207.46.127.10-207.46.127.247
207.46.199.161-207.46.199.254

 

Featured Threads

My Threads

Hot Threads This Week

Hot Threads This Month