Googlebot Crawling

What time of day?

[johnser]

Does anyone know what time of day/night, most of the Googlebot crawls start at?

I don't mean just robots.txt hits from G, I mean a crawl of 10 or 100+ pages.

Our own logs for a variety of sites big & small show a tendancy for crawls to start approx 12.30-1am EST which seems to make sense from an Internet traffic perspective.

Can anyone support this or point to a different timeframe?
TIA
J

[Stefan]

Yeah, I see the same tendency. It can drop by any time of day though, of course. Interesting thing... I often find all the SE's very busy on Sundays which are my slowest days.

[killroy]

Google hits each of my sites for around 5000 pages every weekend, spread across fri-sat-sun

SN

[too much information]

I get a few interior page hits durring the day, and an ocassional deep crawl durring the day, but overall I see the 3am deep crawl more often.

[PizdusInc]

The crawlers come and go during the day, but towards the end of the day they pick up a lot! It makes sense though, not a lot of traffic coming through at the end of the day.

[espeed]

Some of my sites get hit 24x7 non-stop -- there isn't a start/stop time.

[I_am_back]

Some of my sites get hit 24x7 non-stop -- there isn't a start/stop time

Me too for my site. I have thought about using a Robot file to limit this, and save bandwidth, but I don't want to tempt fate either. I will live with the extra Bandwidth I guess.

[stargeek]

I get lots of crawler hits all during the day but most of the big, deep crawls happen over night.

[GranPops]

Massive.............between 0600 and 0700 GMT

[I_am_back]

[quote]happen over night.[/qoute]

Hmmm, last I heard there were 24 different time zones in the worl :o)

[seindal]

I get most Gbot traffic in the morning hours, 06-12 CET, which also happens to be the slowest hours on my sites. I guess somehow google figured that out :-)