how do you see, if fast is dancing?

looking for da url

[pontifex]

hi folks,

how could i see, if fast is dancing?
is there a www2.alltheweb.com like www2.google.com?

just wondering...

pontifex

[lazerzubb]

There are different sub domains for alltheweb, but no one seems to be the same as www2/3 for google, you often see that FAST is dancing when you see an increase in pages for a keyword, they often add more pages all the time, and you also have the link: commando which is pretty good, to see if has begun.

[pontifex]

thanks lazerbubb,

do you have any experience about the time a page takes until beeing listed?

fast is spidering "heavy" right now on our servers, taking 30-70 pages a minute (we host about 70 customers on a linux box)...

As far as I know, google is about to start spidering, just saw it 2-3 times in the last 30 minutes... then
it takes 3 weeks until listing, right?

greetz from germany,
pontifex

[lazerzubb]

Some more information about fast here [webmasterworld.com]

2# how often do they update their Index.

The last I heard (4 weeks ago) was that they Update 25% of the index every week.
So when 1 month has gone they should have updated the entire index.
They also update sites which changes it’s content more often.
Also popular sites are updated more often.
FAST’s spider can crawl up to 150 million pages a day.
When Q2 ends FAST should have 2 Billion pages indexed.

So your site gets indexed pretty FAST, if it's spidered.

[heini]

In theory Lazerzubb is right, it should be added though that despite heavy crawling many sites do appear with remarkable delay in the index. Also frequently sites get spidered and only main pages get listed.
If you read back through many of the last threads in this forum you will get some real life experiences from the members here.