Getting two forms of Scooter now

Last week it was one, this week 'tis another

[Eric_Lander]

Two of three of the largest UA's coming through a new site are:

(5573 hits) Scooter/3.2
(4726 hits) Scooter/3.3

The interesting thing here, is that the Scooter with the most action, is a lower version UA, and came through THIS week. The newer version of Scooter came through and snagged less last week.

Any idea what, if any, differentiates the two of these?

[pendanticist]

Uh, make that three (counting your 3.2) from three different IP Numbers at least by my accounting.

216.39.50.143 - - [28/Apr/2003:08:25:29 -0700] "GET /robots.txt HTTP/1.1" 200 220 "-" "Scooter/3.3_SF"

216.39.48.65 - - [28/Apr/2003:10:32:12 -0700] "GET /blahblah.html HTTP/1.0" 200 1610 "-" "Scooter/3.3"

216.39.50.160 - - [28/Apr/2003:17:01:53 -0700] "GET /robots.txt HTTP/1.1" 200 220 "-" "Scooter/3.3_SF"

Those ending _SF were the lessor requests and 3.3 the most frequent.

Don't know if this helps your question, but this is what I've seen today.

Pendanticist.

[wilderness]

Eric and Pendanticist,
In my 3 years of monitoring logs there has likley been perhaps a dozen Scooter/Intomi bot versions. Perhaps I'm exaggerating but there has/is more than a few. I rarely even keep track of them.
There are exceptions.
A short time back 1.0 reappeared and began grabbing images and more importantly in exluded folders. At that time I denied a portion of their range.
You'll be glad to know that range was recently allowed.

Should they beging traversing excluded folders again? They would be denied in a "heartbeat."

Don

[marcs]

Here's another one in addition to 3.2, 3.3 and 3.3_SF

scooter16.sv.av.com - - [23/Apr/2003:23:56:39 -0700] "GET /robots.txt HTTP/1.0" 200 44 "-" "Scooter/3.3.vscooter"

This one seems to grab robots.txt and .jpg files only. It does not grab web pages nor .gif images.

[pendanticist]

Ok Don, Thanks. :)

Pendanticist.

[Eric_Lander]

Okay, good deal. I've seen gobs and gobs of hits from 3.3, but almost never 3.2 -- and that was one of the primary reasons I was surprised to see it in at such a high volume.

Beyodn that, I just found it interesting that about 70% of the files on this site were picked by both versions.

[wilderness]

grab robots.txt and .jpg files

This is a bit off topic for this thread however it fits in nicely and sort of resolves :-)

Some time ago I decided to rename all my images. Rather than using names they were given a numerical sequence. It did take time and it does cause extra work in tracking.

It was all done as a result of using a name of a file that drew way too much traffic for that image. There were many attempts to deep link too that image.
In the process of renaming the files to numbers, the files were all transfered to an excluded folder.

The end result is that all the image bots cannot/should not spider any of my images. If by accident that does occour?

Unless somebody is looking for a file numeral rather than a name they are not likely to find my imges. :)

Don

[Eric_Lander]

Unless somebody is looking for a file numeral rather than a name they are not likely to find my imges. :)

--- Now thats an interesting idea. I've seen a few too many pages I've worked with getting hit up by various image-search features. Guess it'll help to keep a page more KW dense too without throwing in longer file calls.