UA Lifeboat

followed by Mozilla/4.0 (compatible; MSIE 4.0; Windows NT; ....../1.0 ).

[bobriggs]

whatever.cerberian.com (12.110.28.5), with a UA of Lifeboat. It picked up three pages in one second, did not request robots.txt.

Then about 8 seconds later, 63.229.140.41, (US West) took all pages on the site, followed offsite links (using AXS tracking) and followed all other perl scripts - but no form elements. The process took about twenty minutes. The delay between each page was 10-15 seconds. The user agent was Mozilla/4.0 (compatible; MSIE 4.0; Windows NT; ....../1.0 ). (The dots were in the logs, I didn't put them in there). Again, no robots.txt.

I don't know whether the two were related, but they entered the site from the same page (which is 2 levels below the root and does have inbound links to it)

Checking www.cerberian.com, I see that it offers client content filtering. If the two are related, why did the second take the entire site? Anybody have any experience with this/these one(s)?

[Key_Master]

IP: 12.110.28.5
Host: whatever.cerberian.com
User Agent: Lifeboat

It hit me too using a shorter UA. Hit an ODP listed page and left. I'm inclined to call it a spider. They might be experimenting with user agent names.