RichTC - 11:29 pm on Jul 17, 2005 (gmt 0)

Now i have a similar problem with it. Its eating loads of bandwidth and crawling loads of pages.

Ive had 24,000 hits in four days and its had almost 3GB of Bandwidth - I wouldnt mind if it indexed some of the pages its cashed, currently ive only a few pages in the index, our home page was last updated about a year ago!.

I can only conclude that its either imposed some sort of penalty on us but still cashing pages but not including them in the index or it updates its index with snail pace.

Either way i think we need to block it for all the good it does. We see next to no traffic from ASK anyway.