Page is a not externally linkable
thirteen - 5:57 pm on May 26, 2011 (gmt 0)
I have a dilemma. I would like to let Yandex crawl and index my sites. However, a few years ago, I banned all incoming traffic (using .htaccess) from Russia because my logs showed suspicious hacking probes and possible scraping activities. And also, my intended audience aren't Russians, so traffic from there were not meaningful.
Yandex seems like a legitimate site and they are trying to establish a presence in the USA search engine space but yandex.com url shows that it is originating from Russia.
How can I give Yandex search engine an exemption and allow them to crawl and index my site? I don't have Yandex block of IP address.