Page is a not externally linkable
- Search Engines
-- Search Engine Spider and User Agent Identification
---- htaccess and banning bots
wilderness - 9:41 pm on May 31, 2013 (gmt 0)Thread source:: http://www.webmasterworld.com/search_engine_spiders/4579553.htm
hope you and Yandex are happy together ;)
BTW, Yandex is one of the robots.txt compliant bots I mentioned.
Unfortunately the bot generally uses IP's that I've denied and gets denied anyway.
Brought to you by WebmasterWorld: http://www.webmasterworld.com