Welcome to WebmasterWorld Guest from 54.197.94.141

Forum Moderators: open

Message Too Old, No Replies

New FAST spider?

hmmmm?

   
2:17 pm on Jun 12, 2001 (gmt 0)

10+ Year Member



Im seeing the following in my logs

Visitor IP: 208.186.202.28
UA: FAST-WebCrawler/2.2.6 (crawler@ah-ha.com; [ah-ha.com...]

Does anyone what what type of relationship FAST and AH-HA have? Should I be feeding them optimized pages for FAST?

Any help is appreciated

2:59 pm on Jun 12, 2001 (gmt 0)

10+ Year Member



i saw the same, and i saw that in there FAQ

"The FAST Web Crawler is a distributed crawler that collects content from the web for use by ah-ha.com's Web Search."

4:43 pm on Jun 12, 2001 (gmt 0)

WebmasterWorld Senior Member littleman is a WebmasterWorld Top Contributor of All Time 10+ Year Member



This has been an issue for me for over a year now. The databases are not at all in sink. It looks to me like they are independent of each other, but there is a possibility that Fast will do a uni-directional data dump -- or even some cross referencing.
 

Featured Threads

Hot Threads This Week

Hot Threads This Month