- - Search Engines
- -- Search Engine Spider and User Agent Identification
- ---- htaccess and banning bots
wilderness - 9:41 pm on May 31, 2013 (gmt 0)
hope you and Yandex are happy together ;)
BTW, Yandex is one of the robots.txt compliant bots I mentioned.
Unfortunately the bot generally uses IP's that I've denied and gets denied anyway.
Thread source: http://www.webmasterworld.com/search_engine_spiders/4579553.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com