Page is a not externally linkable
- Search Engines
-- Search Engine Spider and User Agent Identification
---- MSNBot posing as Internet Explorer 7 and not reading robots.txt?
wilderness - 6:22 pm on Jun 25, 2013 (gmt 0)Thread source:: http://www.webmasterworld.com/search_engine_spiders/4587076.htm
I've posted these a couple of times.
The forum breaks one or more due to spaces. I've tried alt-insertion.
SetEnvIf User-Agent " ; " keep_out
SetEnvIf User-Agent " \( " keep_out
SetEnvIf User-Agent "; " keep_out
Brought to you by WebmasterWorld: http://www.webmasterworld.com