Welcome to WebmasterWorld Guest from 54.196.217.43

Forum Moderators: mack

Message Too Old, No Replies

Does blocking "stealth" Microsoft crawlers impact search results?

     
3:39 pm on Apr 30, 2012 (gmt 0)

Preferred Member

10+ Year Member

joined:Mar 10, 2004
posts: 386
votes: 8


One of my sites gets hit thousands of times per day from Microsoft IPs with UAs not identifying as Microsoft crawlers (bingbot, msnbot, etc.). Has anyone blocked these, and if so, has it impacted search results?
4:45 pm on Apr 30, 2012 (gmt 0)

Senior Member from US 

WebmasterWorld Senior Member lucy24 is a WebmasterWorld Top Contributor of All Time Top Contributors Of The Month

joined:Apr 9, 2011
posts:12700
votes: 244


I block all plainclothes MSIEbots for the rock-solid reason that they don't honor (or even read) robots.txt.

Has it affected search results? Hm, I don't get a lot of bing traffic-- but who does?
7:27 pm on Apr 30, 2012 (gmt 0)

Senior Member from GB 

WebmasterWorld Senior Member dstiles is a WebmasterWorld Top Contributor of All Time 5+ Year Member Top Contributors Of The Month

joined:May 14, 2008
posts:3091
votes: 2


I'll second that.