Mozilla/3.01 (compatible;)

[JAB Creations]

Mozilla/3.01 (compatible;) seems to be a robot but is coming from ALOT of various IPs.

[wilderness]

There are many thread on this in the archives.
Littleman gave a decent expanation in this thread in 2001.

[webmasterworld.com...]

[JAB Creations]

Ok so whats a commercial scavenging bot? This a pre-cache bot or?

[wilderness]

"pre-cache bot?"

I provided a link to 1st thread of siginifance which provided a reasonable explantion, even though that thread was 3+ years old.

Please utilize the Webamster archives to search

"Mozilla/3.01"

You will find many many listings of which some will be recent. As previously mentioned, these and other short similar UA's have been discused time and again, over and over.

I have it denied (my choice)using the following line (s):

SetEnvIf User-Agent compatible)$ keep_out
SetEnvIf User-Agent compatible\;)$ keep_out
SetEnvIf User-Agent ^Mozilla/4\.0$ keep_out
SetEnvIf User-Agent ^Mozilla/5\.0$ keep_out