How much time for newly "deep" crawled page to appear?

[brakkar]

Hi,
my site got its monthly deep crawnl on january 5.

Still, google shows the old pages from the last deep crawl (last month) and doesn't show the new pages that were indexed during the recent deep crawl.

How much time, at maximum, can it take for a deep crawl result to appear.

I know some people may argue that there is no deep crawl anymore... the fact is that on my site, I have 3 types of google behavior:

- Front page ping ( between 1- 3 days).
- First level crawl (crawl the pages linked from the front page but doesn't go deeper: once a week approx).
-Deep crawl: every 20-30 days, indexes ALL the pages

Cordially,
Brakkar

[ThomasB]

Deep crawl: every 20-30 days, indexes ALL the pages

I think that's almost the answer. Why should they deep-spider again if they haven't already built their entire new index?

[Stefan]

I'm one of those who would say that there is no deepcrawl. Perhaps the frequency of crawling is dependent on PR. I run only one site so that's all I can judge by.

> - Front page ping ( between 1- 3 days).

Every day for us.

> - First level crawl (crawl the pages linked from the front page but doesn't go deeper: once a week approx).

Every day for us.

> -Deep crawl: every 20-30 days, indexes ALL the pages

64.68.xx.xx looks at about 20% of our ~170 pages every day, but with the really "inner" pages getting shunted through so that they only all get crawled over a period of about 20 days. We never have a particular "deepcrawl" as such, though.

How much time, at maximum, can it take for a deep crawl result to appear.

The deepfreshbot hits will usually start fluxing in and out after a few days, but not stick until some sort of "Default Cache Update" happens, roughly every 4 weeks.

[antrat]

According to Google it's still about once a month
[google.com...]

[Stefan]

That's pretty old stuff, Antrat. We're in the days of the Rolling Update. That page has been there for many, many months, (I guess they don't want to commit).

Our site has no deepcrawl; a good chunk of the site is looked at every day, compared to pre-Esm/Dom, and there is no particular increase in crawling activity from day to day.

[antrat]

Old it is! Not as old as me though :o) I still tend to see it as true though.

[Stefan]

Not as old as me though

I'm no spring chicken, myself... :-)

Ok, I'll agree that there seems to be some sort of cache update that happens, perhaps about every 4 weeks, but honestly, we never have any particular increase in googlebot activity that would be similar to an old-style deepcrawl. We're PR6 index, with some of the inner pages PR6 and most of the rest 5 or 4... maybe that's why we see the bot so often. We don't get a deepcrawl though, just lots of daily deepfreshbot hits that show changes we've made in the serps after a few days.

<edit>typo

[Powdork]

Brakkar's example of crawling behaviour fits what I see too. I added a number of new pages which were completely ignored by freshbot, though she continued to crawl all the other pages feverishly. Then, on the fifth, she came and GOT everything. I expect these pages will be added in during the next DCU (Default Cache Update).