Page is a not externally linkable
- Search Engines
-- Search Engine Spider and User Agent Identification
---- More Chinanet
incrediBILL - 10:38 pm on Nov 23, 2012 (gmt 0)
Another method is to block the language such as:
RewriteCond %{HTTP:Accept-Language} (zh)$ [NC]
RewriteRule .* - [F,L]
Thread source:: http://www.webmasterworld.com/search_engine_spiders/4521839.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com