Scooter on the move again

[Olaf]

I just noticed Scooter in my logs (Scooter-W3.1.2). When I went to check how much it had grabbed I was stunned.

72.500 pages in the past few days, and is going at a 1 page per 1-2 seconds as I write this.

The site deals with it ok, Since I haven't been in AV's index its good to see him.

ps. I did not pay for any inclusion.

[Marcia]

Thanks for letting us know, Olaf. I've also noticed a bit of activity, but not this much. I hope this means an update soon.

In a post last fall, backus mentioned this about Scooter:

ate everything, including .css files I have blocked in the robots.txt!!!!

I wonder if anyone is noticing this happen now.

[Olaf]

Its seems to be behaving.
It has not grabbed anything that is disallowed in my robots.txt.