Forum Moderators: goodroi
According to BOT website:
ID-Search.org is a research project started by a group of Russian candidates from the cities of Saint-Petersburg, Nizhnii Novgorod and Novosibirsk.
This BOT does NOT follow robots.txt so only way to stop it is to either ban the IPs at the firewall level or add its agent to your .htaccess
Companies site:
IDBot can recognize the directives from robots.txt files only partially, which is the result of the scantiness of our resources. Full support of robots.txt will be launched soon.
For quick reference here is our .htaccess entry.
RewriteCond %{HTTP_USER_AGENT} ^IDBot/1\.0 [NC,OR]
Cheers,
JC
[edited by: JohnCanyon at 5:22 pm (utc) on June 29, 2007]