- - Search Engines
- -- Search Engine Spider and User Agent Identification
- ---- To Block or Not To Block That is The Question
keyplyr - 11:56 pm on Jan 28, 2014 (gmt 0)
@trintragula - Possibly a bad agent spoofing the Yandex UA?
FWIW - I have never seen Yandex behave badly and it has always obeyed robots.txt. I actually get triple digit human traffic from Yandex, more than Bing occasionally.
Thread source: http://www.webmasterworld.com/search_engine_spiders/4640214.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com