caught this one sniffing around today. Boy these guys are getting bad. If we didn't have Russian customers I'd block the whole country.
incrediBILL
6:01 am on Oct 31, 2012 (gmt 0)
Unless you do business with them you're better off blocking the Ukraine, Romania, Russia, etc.
lucy24
6:44 am on Oct 31, 2012 (gmt 0)
Oh, hey, I've got those blocked already :) Assorted robots, notably including ahrefs whose distinctive behavior pattern is to first pick up pages and then get robots.txt. Presumably followed by "Darn! I could have got robots.txt in the first place and made myself look good. None of those pages was disallowed anyway."
I wouldn't have the heart to block Russia. Sometimes I get people from Yandex looking for pictures of rats ;)
