egspd405.teoma.com and bandwidth

This spider eats up my site!

[Red5]

I've been analysing my site stats with the aim of reducing the bandwidth used when visitors view my pages. So far I've successfully reduced the overhead by optimising pages and reducing images.

I now, however, face a new problem. The AskJeeves/Teoma spider at 65.214.36.155 (egspd405.teoma.com) was responsible for 13.5% of all the bandwidth used on my site so far this month, and last month is was the second highest user of bandwidth at 2.32%.

My options seem to be to either ban the robot and lose the little traffic Teoma sends me, or leave it to go about its business.

What would you all suggest I do about this?

[Smiley]

If your site is commercial then I think you would be mad to ban the Teoma robot.

I'd suggest you try and bargain with your host for better priced bandwidth.

[Red5]

My site is linked in my profile. It is educational, but does have an Amazon affiliate shop attached. :-)