homepage Welcome to WebmasterWorld Guest from
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Visit PubCon.com
Home / Forums Index / Yahoo / Deprecated - Altavista, Alltheweb.com
Forum Library, Charter, Moderator: open

Deprecated - Altavista, Alltheweb.com Forum

New FAST spider?

 2:17 pm on Jun 12, 2001 (gmt 0)

Im seeing the following in my logs

Visitor IP:
UA: FAST-WebCrawler/2.2.6 (crawler@ah-ha.com; [ah-ha.com...]

Does anyone what what type of relationship FAST and AH-HA have? Should I be feeding them optimized pages for FAST?

Any help is appreciated



 2:59 pm on Jun 12, 2001 (gmt 0)

i saw the same, and i saw that in there FAQ

"The FAST Web Crawler is a distributed crawler that collects content from the web for use by ah-ha.com's Web Search."


 4:43 pm on Jun 12, 2001 (gmt 0)

This has been an issue for me for over a year now. The databases are not at all in sink. It looks to me like they are independent of each other, but there is a possibility that Fast will do a uni-directional data dump -- or even some cross referencing.

Global Options:
 top home search open messages active posts  

Home / Forums Index / Yahoo / Deprecated - Altavista, Alltheweb.com
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved