Forum Moderators: open

Message Too Old, No Replies

how do you see, if fast is dancing?

looking for da url

         

pontifex

12:01 pm on Jun 2, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



hi folks,

how could i see, if fast is dancing?
is there a www2.alltheweb.com like www2.google.com?

just wondering...

pontifex

lazerzubb

12:08 pm on Jun 2, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



There are different sub domains for alltheweb, but no one seems to be the same as www2/3 for google, you often see that FAST is dancing when you see an increase in pages for a keyword, they often add more pages all the time, and you also have the link: commando which is pretty good, to see if has begun.

pontifex

12:14 pm on Jun 2, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



thanks lazerbubb,

do you have any experience about the time a page takes until beeing listed?

fast is spidering "heavy" right now on our servers, taking 30-70 pages a minute (we host about 70 customers on a linux box)...

As far as I know, google is about to start spidering, just saw it 2-3 times in the last 30 minutes... then
it takes 3 weeks until listing, right?

greetz from germany,
pontifex

lazerzubb

12:19 pm on Jun 2, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Some more information about fast here [webmasterworld.com]

2# how often do they update their Index.

The last I heard (4 weeks ago) was that they Update 25% of the index every week.
So when 1 month has gone they should have updated the entire index.
They also update sites which changes it’s content more often.
Also popular sites are updated more often.
FAST’s spider can crawl up to 150 million pages a day.
When Q2 ends FAST should have 2 Billion pages indexed.

So your site gets indexed pretty FAST, if it's spidered.

heini

1:06 pm on Jun 2, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



In theory Lazerzubb is right, it should be added though that despite heavy crawling many sites do appear with remarkable delay in the index. Also frequently sites get spidered and only main pages get listed.
If you read back through many of the last threads in this forum you will get some real life experiences from the members here.