Welcome to WebmasterWorld Guest from 54.226.246.160

Forum Moderators: Ocean10000 & incrediBILL

Message Too Old, No Replies

New Fast/Overture UA

Yet another new one from FAST

     

jdMorgan

11:06 pm on Sep 8, 2003 (gmt 0)

WebmasterWorld Senior Member jdmorgan is a WebmasterWorld Top Contributor of All Time 10+ Year Member



66.77.73.128 - - [08/Sep/2003:14:51:39 -0400] "GET /robots.txt HTTP/1.0" 200 3670 "-" "Overture-WebCrawler/3.8/Fresh (atw-crawler at fast dot no; [fast.no...]

Just spotted today.

It seems to be looking for the same old "fast" robot name in robots.txt. I'm assuming this because it thought it was allowed to spider my sites. But having an unrecognized user-agent string, it wasn't, and got a 403. Yeah, I fixed it! :)

Jim

heini

11:41 pm on Sep 8, 2003 (gmt 0)

WebmasterWorld Senior Member heini is a WebmasterWorld Top Contributor of All Time 10+ Year Member



Hmm, probably a matter of rebranding (in logs ;))

jdMorgan

12:23 am on Sep 9, 2003 (gmt 0)

WebmasterWorld Senior Member jdmorgan is a WebmasterWorld Top Contributor of All Time 10+ Year Member



Yeah, it's a good argument for NOT using your company name in your robot name, since it might change tomorrow.

Jim

percentages

7:09 am on Sep 10, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



>Yeah, it's a good argument for NOT using your company name in your robot name, since it might change tomorrow.

LOL...definitely true if you happen to be an SE spider ;)

fr_cnx

2:11 pm on Sep 10, 2003 (gmt 0)

10+ Year Member



this robot has visited my site in the same time as Fast, could it be just visiting Overture customers?

sidyadav

4:37 am on Sep 11, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I'm assuming when the acquiring of Overture is finally finished by Yahoo, the User-Agent should look like this:
Yahoo-WebCrawler/3.8/Fresh (atw-crawler at fast dot no; [fast.no...]

LOL!

Sid

Marcia

10:09 am on Sep 11, 2003 (gmt 0)

WebmasterWorld Senior Member marcia is a WebmasterWorld Top Contributor of All Time 10+ Year Member



>>could it be just visiting Overture customers?

No, I've just caught it at one site that had only a temporary index page up, the rest was down for a couple of months. Tiny site, I put the normal page back up on the 4th of September and the other 4 pages back up, and that user agent plus the normal one got all 5 pages between then and yesterday. It's not in Overture.

 

Featured Threads

Hot Threads This Week

Hot Threads This Month