Forum Moderators: phranque
the last three months, "aranhabot" has used up between 8 and 9% of my total bandwidth....I am using 22gb a month so this is not small cheese!
have altered my robots.txt and added them to my bad bot .htaccess script too.
who the hell are they? sommat to do with alexa/amazon I heard once. did a search on google for them and out of four billion pages in their index, only one reference to them....and that here at WebmasterWorld and only in one sentence!
http://www.webmasterworld.com/forum11/1515.htm [webmasterworld.com]