Welcome to WebmasterWorld Guest from 54.159.50.111

Forum Moderators: Ocean10000 & incrediBILL

Message Too Old, No Replies

MSNbot changing to Bingbot on Oct.1, 2010

     
1:02 pm on Jun 29, 2010 (gmt 0)

Administrator from US 

WebmasterWorld Administrator incredibill is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Jan 25, 2005
posts:14624
votes: 88


Per the Bing blog [bing.com]:
On October 1st, 2010, we will drop the beta designation from the Bing crawler and change the name of the crawler to reflect Microsoft's new brand for search. Instead of the old msnbot 2.0b showing up in your server logs, the updated user agent will be:

Mozilla/5.0 (compatible; bingbot/2.0 +http://www.bing.com/bingbot.htm)

The HTTP header From field will also change as shown below:

From: msnbot(at)microsoft.com

will become

From: bingbot(at)microsoft.com

So anyone herding msnbot using .htaccess or other means will need to start adjusting your software accordingly.

However, don't worry about your robots.txt file however, because they plan to retain backwards compatibility.
We want webmasters to know that bingbot will still honor robots.txt directives written for msnbot, so no change is required to your robots.txt file(s).


There was no official mention about whether their rDNS used for bot validation would change so I suspect it will still retain the following format:
msnbot-aaa-bbb-ccc-ddd.search.msn.com
5:42 pm on June 29, 2010 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Dec 26, 2003
posts:1284
votes: 0


about time ;)
10:24 pm on June 29, 2010 (gmt 0)

Senior Member from GB 

WebmasterWorld Senior Member dstiles is a WebmasterWorld Top Contributor of All Time 5+ Year Member Top Contributors Of The Month

joined:May 14, 2008
posts:3092
votes: 2


Shame the important part of the UA no longer starts at the beginning of the string. Takes just a bit longer to parse. :(

What about the media bots etc? Are they going to be exactly the same UA? If so how will we know to block the things?