Googlebot visit the same page several times in a few days
1 visit from deepbot and 2 from freshbot in 3 days
leifwessman
4:22 pm on Mar 18, 2003 (gmt 0)
Is this normal behaviour? Googlebot didn't send the HTTP_IF_MODIFIED_SINCE header at any time, I log everything...
Since I have lots of pages (> 50000) It's bad for my server having to tell google the same information again, again and again. I don't think googlebot should visit that often. It doesn't make any sence...
Leif
Jesse_Smith
5:10 pm on Mar 18, 2003 (gmt 0)
That's exactly what it does. Freshbot comes over and over, otherwise it wouldn't be a fresh update.