Welcome to WebmasterWorld Guest from 54.144.80.75

Forum Moderators: goodroi

Message Too Old, No Replies

What's the difference between bing bot and Microsoft?

Microsoft IP staying too long...banned for now, what's with that?

     
3:52 am on Jun 4, 2011 (gmt 0)

Junior Member

10+ Year Member

joined:Apr 29, 2003
posts: 126
votes: 0


Blocked Microsoft IP - 131.107.151.80
Bing's ok 65.52.110.64, but why is MS sucking up my images?

from "GET /images[03/Jun/2011:17:04:25 -0700
to "GET /images[03/Jun/2011:17:04:26 -0700]

then back from:
"GET /images[03/Jun/2011:19:16:40 -0700]
to
"GET /images[03/Jun/2011:19:16:40 -0700

131.107.151.80 - - [03/Jun/2011:19:16:40 -0700] "GET /images/01_trF8F5AE.png HTTP/1.1" 200 739 "http://www.mysite.com/" "Mozilla/5.0 (compatible; MSIE 9.0; Windows NT 6.1; WOW64; Trident/5.0)"

Is MS the smae animal as bing bot?
Thanks
E
9:00 pm on June 4, 2011 (gmt 0)

Senior Member from GB 

WebmasterWorld Senior Member dstiles is a WebmasterWorld Top Contributor of All Time 5+ Year Member Top Contributors Of The Month

joined:May 14, 2008
posts:3092
votes: 2


Block all 131.107/16. It's not an MS bot block, more of a general hosting range. Many nasties ceom from there, much as they do from Amazon AWS (see WebmasterWorld "Search Engine Spider and User Agent Identification" for details of that!).

bingbot IS msnbot - just the name changes - but I think you can control it in robots.txt by using either word. Neither word would work on the 131.107/16 bots as I doubt very much if they even look at robots.txt.

If you have a lot of scrapes/attacks on your site then I really recommend reading the "Search Engine Spider and User Agent Identification" forum hereabouts.
10:21 pm on June 4, 2011 (gmt 0)

Junior Member

10+ Year Member

joined:Apr 29, 2003
posts: 126
votes: 0


dstiles,
thanks, and blocked that ranged you mentioned.

am familiar with Amazon AWS nasties. my robots file is well maintained thanks to you & others on this great forum!

will keep your advice on Search Engine Spider and User Agent Identification section here.

thanks again!

e
 

Join The Conversation

Moderators and Top Contributors

Hot Threads This Week

Featured Threads

Free SEO Tools

Hire Expert Members