New Fast/Overture UA

Yet another new one from FAST

[jdMorgan]

66.77.73.128 - - [08/Sep/2003:14:51:39 -0400] "GET /robots.txt HTTP/1.0" 200 3670 "-" "Overture-WebCrawler/3.8/Fresh (atw-crawler at fast dot no; [fast.no...]

Just spotted today.

It seems to be looking for the same old "fast" robot name in robots.txt. I'm assuming this because it thought it was allowed to spider my sites. But having an unrecognized user-agent string, it wasn't, and got a 403. Yeah, I fixed it! :)

Jim

[heini]

Hmm, probably a matter of rebranding (in logs ;))

[jdMorgan]

Yeah, it's a good argument for NOT using your company name in your robot name, since it might change tomorrow.

Jim

[percentages]

>Yeah, it's a good argument for NOT using your company name in your robot name, since it might change tomorrow.

LOL...definitely true if you happen to be an SE spider ;)

[fr_cnx]

this robot has visited my site in the same time as Fast, could it be just visiting Overture customers?

[sidyadav]

I'm assuming when the acquiring of Overture is finally finished by Yahoo, the User-Agent should look like this:

Yahoo-WebCrawler/3.8/Fresh (atw-crawler at fast dot no; [fast.no...]

LOL!

Sid

[Marcia]

>>could it be just visiting Overture customers?

No, I've just caught it at one site that had only a temporary index page up, the rest was down for a couple of months. Tiny site, I put the normal page back up on the 4th of September and the other 4 pages back up, and that user agent plus the normal one got all 5 pages between then and yesterday. It's not in Overture.