homepage Welcome to WebmasterWorld Guest from 54.204.127.59
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
Forum Library, Charter, Moderators: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification Forum

    
New AV/Y! Spider
Scooter/3.3Y!CrawlX
0l0l0l0




msg:408246
 5:24 pm on Aug 3, 2004 (gmt 0)

I noticed this in the logs on one of my sites this morning...

IP: 66.163.170.193
UA: Scooter/3.3Y!CrawlX

Requested robots.txt and the index page.

Not sure if anyone has mentioned this UA yet.

Cheers

 

volatilegx




msg:408247
 7:00 pm on Aug 3, 2004 (gmt 0)

I've also seen it crawling this morning, same IP and UA.

wilderness




msg:408248
 7:03 pm on Aug 3, 2004 (gmt 0)

Diito that Dan.

Welcome to Webmaster World "0l0l0l0 or Cheers [;)]"

privacyman




msg:408249
 10:36 pm on Aug 16, 2004 (gmt 0)

Since AltaVista was purchased by Overture the A/V engine
often uses the listings in Yahoo. Lookup of IP 66.163.170.193
which is often used for the UA of Scooter/3.3Y!CrawlX
reveals that the IP "does" belong to Yahoo in San Jose, CA, USA

Having noticed comment by others that they have been blocking
this UA, thought I should pass this info on as it does seem valid
as a good bot.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved