secret site

deep crawling this month

[eveningwalk]

Hi,

Had my brand new and "secret site" deep crawled on Nov 11th and 12th, as I didn't have a robots.txt file. It turns out to be okay as I go live next week. Now, what's the time gap from getting deep crawled to being listed on the SERPs - 2 days? 2 weeks? And is the Nov 11th deep crawl a continuation of the Oct deep crawl?

Regards,
eveningwalk

[troels nybo nielsen]

Welcome to WebmasterWorld, eveningwalk.

Which robot were you spidered by, crawler or crawl?

[eveningwalk]

It was crawlx - actually I'm assuming that crawlx is the deep crawl and crawlerx is the freshbot. Is that right? And crawlerx is yet to hit me.

[troels nybo nielsen]

You're quite right. With crawlx you can expect to be in the SERP's at the next big update in a week or two.

[eveningwalk]

Thanks Troels. Btw, did the November deep crawl start in the first half of the month? Or do we have 2 deep crawls this month? And if there are 2 crawls, does that mean 2 updates?

[troels nybo nielsen]

Googlebot crawls all the time. It has to. (There are quite a few pages out there!) One might say that the november crawl started as soon as the october crawl was finished.

One can never be quite sure about the big update, but my guess would be that at least for the next few months we will still have one monthly update with adjustments of pageranks.