Page is a not externally linkable
- Search Engines
-- Search Engine Spider and User Agent Identification
---- msnbot-media

wilderness - 9:16 pm on Dec 23, 2012 (gmt 0)


fails header check

131.253.38.21 - - [23/Dec/2012:17:42:01 +0000] "GET /robots.txt HTTP/1.1" 403 559 "-" "msnbot-media/1.1 (+http://search.msn.com/msnbot.htm)"

Thread source:: http://www.webmasterworld.com/search_engine_spiders/4470273.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com