joined:July 11, 2008
It's back again and frankly this is annoying me, i dont like blocking the bot even if it only sends me 1% of my daily traffic i'd like to give it a fair shot but when it comes to load i'd rather have my normal load of 0.50 rather than 5, 10 or even 15 at times.
I have spoke to a few engineers over there, they promise to set a delay their end as the bot ignores robots.txt commands but with little effect.
So Bing, i assume you read here, sort your bot out, it's a massive resource hog and how the hell do you expect to win over webmasters and searchers alike if we are all blocking your bot. Right now i'm having to resort to adding a line in my htaccess.