odd deep crawl pattern

doubly blessed?

[dcheney]

I've been looking over the logs so far this month and the googlebot seems to be doing something odd.

Starting in the evening of 1 Nov I've got the regular deep crawl starting. This goes on for a few days, with a page a minute or so with lots of breaks. This seems to mostly wrap up as usual after several days.

But then starting about midafternoon on the 14th, I start seeing a second "fast" crawl - at about a page per second - through about half my site.

Anyone else seeing this type of pattern?

Total Last Month: 33k files crawled
So far this month: 41k files crawled
Total on site: 20k files

(no obvious difference in source ip's either, seems to be basically the same ones for both phases - and same ones as last month)

[incywincy]

i've certainly seen 2 periods of very deep crawling

i have a site with just over 500 pages, googlebot exhibited the following behaviour:

day pages visits
1 43 18
2 24 14
3 42 19
4 128 95
5 931 349
6 222 57
7 592 311
8 974 257
9 49 30
10 48 20
11 19 17
12 55 22
13 72 51
14 38 24
15 54 18