Forum Moderators: mack

Message Too Old, No Replies

Does blocking "stealth" Microsoft crawlers impact search results?

         

motorhaven

3:39 pm on Apr 30, 2012 (gmt 0)

10+ Year Member Top Contributors Of The Month



One of my sites gets hit thousands of times per day from Microsoft IPs with UAs not identifying as Microsoft crawlers (bingbot, msnbot, etc.). Has anyone blocked these, and if so, has it impacted search results?

lucy24

4:45 pm on Apr 30, 2012 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



I block all plainclothes MSIEbots for the rock-solid reason that they don't honor (or even read) robots.txt.

Has it affected search results? Hm, I don't get a lot of bing traffic-- but who does?

dstiles

7:27 pm on Apr 30, 2012 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



I'll second that.