Forum Moderators: phranque
I used:
RewriteCond %{HTTP_USER_AGENT} ^.*translate.google.*$ [OR]
RewriteCond %{HTTP_USER_AGENT} ^.*bff.*$ [OR]
RewriteCond %{HTTP_USER_AGENT} ^.*world.*$ [OR]
RewriteCond %{HTTP_USER_AGENT} ^.*babel.*$ [OR]
RewriteCond %{HTTP_USER_AGENT} ^.*systranbox.*$
RewriteRule /* [mydomain...] [L,R]
Any help would be appreciated. Thanks!
If its bandwidth, why not use .htaccess to disallow some abusive crawlers?
There are other ways to reduce bandwidth. - Larry