Googlebot does larger crawls once a week on the weekend

Forum Moderators: open

Message Too Old, No Replies

Googlebot does larger crawls once a week on the weekend

A new trend

Clark

11:59 pm on Jul 20, 2003 (gmt 0)

I'm pretty sure we can identify this as a pattern for the third week now. googlebot does at least 2 large crawls every weekend. Looks to me like it's more of a Friday and Sunday thing. Does the WW community agree?

If so we just need to identify how long it takes this data to enter the index.

MrSpeed

1:59 am on Jul 21, 2003 (gmt 0)

That's the way it was for me this weekend.

borisbaloney

2:31 am on Jul 21, 2003 (gmt 0)

It's just circustantial, but my logs conform with your theory.

swampy webber

2:55 am on Jul 21, 2003 (gmt 0)

Actually that may be true to a degree but I have had several hundred visits sporatically every 3-4 days for the past 3 weeks.

TheDave

2:56 am on Jul 21, 2003 (gmt 0)

My site was in the index within a week of registering the domain, with no fresh dates (:D)

Clark

3:07 am on Jul 21, 2003 (gmt 0)

Swampy, over the last week I've been getting probably 1000 - 3000 visits a day as well, but the week before it was a bit more sporadic.

swampy webber

3:13 am on Jul 21, 2003 (gmt 0)

I HAVE had more Googlebots today then any other time this past week though if that goes along with your theory :) Anything to help

Clark

3:32 am on Jul 21, 2003 (gmt 0)

It's still too early to call but with google these days it sure feels good to have *some* kind of repeatable pattern :)

Trisha

4:33 pm on Jul 21, 2003 (gmt 0)

Is that crawlxx or crawlerxx that you are seeing visiting on weekends?

bolitto

4:41 pm on Jul 21, 2003 (gmt 0)

>If so we just need to identify how long it takes this data to enter the index.

When you find out please make sure to post it so GoogleGuy changes it and the fun continues.

Clark

7:58 pm on Jul 21, 2003 (gmt 0)

Trisha, I'm not sure, for zome some reason that does not show up in my logs...