Googlebot traffic.

Whats the most hits from the crawler you have had?

[PaulPaul]

I was wondering what are the maximum pages, people have had crawled.

In a day, in a spidering period (1 month).

I will start. I have had about 5k crawled in a day and about 15k for the period.

[Grumpus]

My first month (March crawl) got 17,000 pages and I premiered at PR 5. My PR went down to 4 for the following three months and the number of pages crawled dwindled down (over those months) to 7,500. I'm PR 5 again for the past few months, but no change in crawl depth.

That brings me to this month. Rate of hits are about the same, but it started right at when the last update started and hasn't stopped, yet. About 18-20 hours a day, 100-180 pages an hour. That puts me at about 25,000 pages for the month, but I'm also getting the "freshbot" coming in and poking around a lot and while some pages make it into the fresh index, these pages still need to be crawled by the regular crawler, so I'm guessing it's closer to 20K that have really been crawled so far.

G.

[europeforvisitors]

I had something like 8,500 pages crawled last month. Since my site has 2,500+ pages, that means each page (on the average) must have been crawled about three times from August 1 through the 31st.

Wouldn't it be nice if each page were listed three times in Google? :-)

[KakenBetaal]

I've had just over 13000 page requests this crawl (26th August through 4th September). Most of those are due to the new forums that I installed two months ago as I otherwise have only just over 200 static pages. My site normally gets around 650 GoogleBot requests for those 200 pages.

A month ago only a few pages from the php forums were crawled, probably because the toolbar was guestimating a PR of 3 for mysite.com/forums/. During that same crawl the bot found the forums in my nav bar, and since this last update has given the forums index page a PR5, same as the rest of the site.

I'll be very interested to see how many of the forum pages make it into the index, given that the bot followed all the email, pm, reply to links, etc. Hopefully most of the 2700 posts I've had since kicking off the site!