Welcome to WebmasterWorld Guest from 126.96.36.199
Forum Moderators: open
Before this massive expansion, FAST aimed at refresh cycles of 9 - 12 days.
A new press release [fast.no] claims a complete update every 7 - 11 days. If FAST could meet that, it surely would put them ahead significantly of the competition.
Will be interesting to see if this holds true.
Can't see how they will go wrong!
It also features around 200 pages from the site that haven't existed for around 2-3 weeks.
This doesn't seem consistent with a 7-11 day refresh cycle.
Fast says a large portion of its index, the popular content, is re- spidered every seven to 11 days, with the remainder being spidered every month or so
Apparently it was Jami Axelroed, ATW senior product manager, who said that.
Now, I'd be very interested in how FAST defines what is popular content...?
[edited by: heini at 7:11 pm (utc) on June 18, 2002]
Can't really imagine that's true. ATW is a specialists engine. Measuring clickpop from ATW would very likely produce a rather distorted picture of what the mass market wants. Add the fact that ATW is only available with an English interface...
>had new content often,
possible. FAST's spider armada often spiders pages en masse without neccesarily refreshing them in the index.
>and pages with a lot of inbound links
Hmm. Would make more sense if refreshing would be triggered by discovering new links.
Knut Magne Risvik, Director of Engineering at FAST, has said in this thread [webmasterworld.com], FAST aims at
being able to cover the most important parts of the web.... that's where our focus lies.
What kind of sites do get refreshed every 7-11 days? Are they in a different db from the sites, that get rather montly updates?
What percentage of the 2,1 Bill. pages is covered by the short update cycle?