I've been analysing my site stats with the aim of reducing the bandwidth used when visitors view my pages. So far I've successfully reduced the overhead by optimising pages and reducing images. I now, however, face a new problem. The AskJeeves/Teoma spider at 65.214.36.155 (egspd405.teoma.com) was responsible for 13.5% of all the bandwidth used on my site so far this month, and last month is was the second highest user of bandwidth at 2.32%.
My options seem to be to either ban the robot and lose the little traffic Teoma sends me, or leave it to go about its business.
What would you all suggest I do about this?
