Page is a not externally linkable
- Search Engines
-- Search Engine Spider and User Agent Identification
---- MSNBot posing as Internet Explorer 7 and not reading robots.txt?
wilderness - 11:04 pm on Jun 25, 2013 (gmt 0)Thread source:: http://www.webmasterworld.com/search_engine_spiders/4587076.htm
|I'd say it's worth a thread of it's own IMO. |
There's a couple of old and similar threads.
lucy started one about the plain-Jane browsers that was MS focused.
Brought to you by WebmasterWorld: http://www.webmasterworld.com