Page is a not externally linkable
- Search Engines
-- Search Engine Spider and User Agent Identification
---- and another gets on.


lucy24 - 7:05 am on Jan 18, 2013 (gmt 0)


:: bump ::

Don't know what MS's long-term plan for this, uhm, rangette is. But the latest batch of logs had them trying it out on msnbot-media. I was alerted by the huge number of requests for robots.txt from an unaccustomed quarter.

:: edit, edit, edit in log-wrangling function ::

bingbot and msnbot don't get the huge number of spoofers that googlebot does, but it's enough that I can't just wave in anyone who flashes a Bingbot ID. Well, I could. This isn't my day job. But I don't feel like it.


Thread source:: http://www.webmasterworld.com/search_engine_spiders/4534499.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com