Everyone ready for the deepcrawl?

Things to do instead of obsessing on the update...

[Stefan]

Clean up code, add pages, think of keyword strategies, etc, etc, etc...

After the Dance comes a closer inspection; this is a good time to become more presentable.

[Powdork]

In addition, when things don't go so well people afterward wish they had the results of their important kw searches as they were before the dance. Or perhaps a copy of their backlinks before the dance, or their competitors backlinks. In short, any information about the current index will disappear after the update is finished. Now , or during the dance, is the time to copy, print, or otherwise save your little slice of the web.

[nadsab]

For the "Deep Crawl", is it regulary scheduled and done on the same day or period of days for every web server/site on the net?

Don't Google space it out and deep crawl some servers on one day and others a few days later, etc.

[Stefan]

It usually starts within a few days of the end of the update, nadsab, and goes for over a week. Yeah, it spaces it out during this period, as you said.

[nadsab]

Thanks Stefan,

The end of the update? Not sure what U mean there. Do you mean a few days after the end of the update from the previous crawl (which may have taken place weeks before)?
Was there an update recently?

[Stefan]

Do you mean a few days after the end of the update from the previous crawl (which may have taken place weeks before)?

Yes. The last update started on Mar 6, I believe. The crawl started around Mar 16 (?) not sure really... but this next update will reflect that last crawl, and then soon after we'll get looked at again for the following update.

[troels nybo nielsen]

Welcome to WebmasterWorld, nadsab

The deepcrawl is generally taken from upside down, beginning with websites, that have PR10 pages. So if your best page is PR4-6 you may expect to be visited a day or a couple of days after you read the first reports from webmasters being visited.

The update lasts some days. First it takes some time to check, if the new index is working allright. And then Google will have to upload this new index to all their datacentres.

[nadsab]

Thanks guys for this info!

So am I correct in understanding that I can see when google starts deep crawling at the link ...

[webmasterworld.com...]

Stephan didn't U mean that the crawl was Mar 6, and the update started Mar 16 (for that crawl) or did I miss something?

So is everyone here expecting google to crawl in the next few days? That what the chatter is about Cassandra?

[Powdork]

Stephan had it right. And Cassandra will be the update resulting from the mid march crawl.

For a list of update dates go here
[webmasterworld.com...]

[nadsab]

Thanks Powdork,

So is the crawl usually about ten days after the pervious update, like in Stephans above explanation? I'm trying to estimate how much time I have after the upcoming update before the next crawl.

[Stefan]

Hey nadsab

I probably have the time of the last deepcrawl wrong... I'd have to dig it out of the logs.

The update starts, goes for 3 - 5 days. Within 2 - 3 days of the end of the update, the deepcrawl starts and goes for 6 - 10 days. Then apx 4 weeks after the beginning of the update, the next update starts based on the deepcrawl mentioned above. All time periods are variable. I hope this is less confusing... others here could explain it more clearly.

Cheers