Page is a not externally linkable
- Search Engines
-- Search Engine Spider and User Agent Identification
---- very unusual swarm of crawlers

lucy24 - 3:43 am on Feb 27, 2012 (gmt 0)


@DeeCee: What he said. Mine now reads

# lock out plainclothes MSIEbot completely

RewriteCond %{REMOTE_ADDR} ^(65\.5[2-5]|157\.(5[4-9]|60)|207\.46)\.
RewriteCond %{HTTP_USER_AGENT} MSIE\ 7\.0;\ Windows\ NT\ [56]\.\d
RewriteRule (\.html|/)$ - [F]

Thread source:: http://www.webmasterworld.com/search_engine_spiders/4421994.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com