Crawl vs. Dance

Consecutive vs. concurrent

[cbooth7575]

Hey everybody,

As I understand it, the crawl is when Googlebot actively indexes pages on the web by crawling links, etc. The "dance" as it is called here is when Google takes all the new-found data, and recalculates everything, such as PageRank, keywords...

My question is whether the two happen consecutively, or concurrrently. My worry is that I've seen posts that the dance is started (and have found this to be trus based on different #s of link:mysite.com results on www, www2, and ww3). The thing is though, that Googlebot hasn't crawled my site in over a month! I'm getting worried.

It's a pretty new site, and I screwed up last month and had PHP sessions turned on, (which appends "?PHPSESSIONID=asdf" to the URLs) so Google didn't follow any links on my page and only indexed the home page. I removed the session handling this month, and have been hoping it'll return, and index the whole thing.....

Any thoughts/comments/ideas that might be of help??

Thanks

[taxpod]

The crawl happens from late in the end of the month to about the tenth. Then the data captured during the crawl is updated near the end of the month. So crawl was beginning of July and the dance is going on now. After the servers settle down - the dance takes a few days, the crawl will begin.

If you were crawled beginning of July or thereabouts, that is what you are seeing on WW3. The next crawl has not started yet.

[cbooth7575]

Thanks taxpod

That makes more sense, and it's good news, but also bad news.

The good news is that I didn't miss out on a crawl for any reason, but the bad news is that it'll be a while before the next deep crawl finally goes live. (Assuming my PHP session handling solution works, that is!)

Cheers

[coconutz]

>The next crawl has not started yet....

Maybe it has? Our site was crawled yesterday.

[taxpod]

Sometimes during a dance there is a crawling but usually even if you are crawled during a dance, you are crawled again early the next month. For example, a couple months ago, my site was crawled say around the 7th. Then the dance occurred sometime around the 25th and during the dance, the site was fully crawled. Then a week, 10 days or so later the site was again crawled.

While many are reporting crawls having occurred in the past several days, many are reporting no activity. So I do not believe a full blowm crawl is ongoing right now.

[yankee]

No crawl activity here either. It should start in a few days.