Page is a not externally linkable
- Search Engines
-- Search Engine Spider and User Agent Identification
---- msnbot-media


wilderness - 3:27 pm on Dec 1, 2012 (gmt 0)


131.253. been acting weird.

131.253.39. gets 403's, while the remainder of the assignments are allowed.

The only thing I see is that temporary and incomplete header check that I installed. I've remarked out the header check and will report back what transpires.


Thread source:: http://www.webmasterworld.com/search_engine_spiders/4470273.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com