Page is a not externally linkable
- Search Engines
-- Search Engine Spider and User Agent Identification
---- msnbot-media


lucy24 - 10:10 pm on Dec 9, 2012 (gmt 0)


Make it a multiple glitch, if so. They came back later in the night-- before I'd got around to uploading the revised .htaccess-- for another page. And tried once more still later, coming away with only the custom 403 page and /boilerplate/errorstyles.css. By then it was 1:30 AM Pacific time, which is not a likely hour for humans at Microsoft to be working late ;)


Thread source:: http://www.webmasterworld.com/search_engine_spiders/4470273.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com