Forum Moderators: open

Message Too Old, No Replies

Your GoogleBot visits for February?

Googlebot patterns

         

Alphawolf

5:04 pm on Mar 1, 2003 (gmt 0)

10+ Year Member



My site which was indexed 2 months ago but just showed up on SERP's last month got the following GoogleBot action for the month of February...

BTW, Google does NOT show any of my backlinks yet (this update- hopefully!) and therefore(?) my PR is 4 and below for all my pages(26).

DeepBot till the 9th then all FreshBot:
===========================================
Sat Feb 01st, 2003 0
Sun Feb 02nd, 2003 0
Mon Feb 03rd, 2003 0
Tue Feb 04th, 2003 0
Wed Feb 05th, 2003 0
Thu Feb 06th, 2003 4
Fri Feb 07th, 2003 19
Sat Feb 08th, 2003 13
Sun Feb 09th, 2003 2
Mon Feb 10th, 2003 0
Tue Feb 11th, 2003 0
Wed Feb 12th, 2003 1
Thu Feb 13th, 2003 0
Fri Feb 14th, 2003 0
Sat Feb 15th, 2003 16
Sun Feb 16th, 2003 29
Mon Feb 17th, 2003 0
Tue Feb 18th, 2003 0
Wed Feb 19th, 2003 1
Thu Feb 20th, 2003 29
Fri Feb 21st, 2003 0
Sat Feb 22nd, 2003 2
Sun Feb 23rd, 2003 0
Mon Feb 24th, 2003 0
Tue Feb 25th, 2003 2
Wed Feb 26th, 2003 2
Thu Feb 27th, 2003 1
Fri Feb 28th, 2003 26
=====================================================

So, what does your GoogleBot February visits look like?

Helping kill the time till the update. <G>

AW

ncw164x

7:57 pm on Mar 1, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



"So, what does your GoogleBot February visits look like?"
Spidering Like nothing I have seen in 3 years

Alphawolf

9:43 pm on Mar 1, 2003 (gmt 0)

10+ Year Member



ncw164x,

>>Spidering Like nothing I have seen in 3 years

Was hoping for a more detailed post. ;)

Can you copy and paste your webstats from GoogleBot visits?

Thanks.

AW

Jesse_Smith

9:52 pm on Mar 1, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



For most of us we get hit WAY too many times to bother counting. For example my Google log is over 400K just from the last 20 days! The freshbot last hit me today. Yesterday I got hit about 270 times on one of my sites.

dcheney

9:57 pm on Mar 1, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



December: 26,294
January: 35,736
February: 45,044
March (this morning only): 1,110

(hits from googlebots, 1 largish site)

yetanotheruser

10:15 pm on Mar 1, 2003 (gmt 0)

10+ Year Member



Alphawolf,

--------------------
212 10/Jan/2003
824 11/Jan/2003
108 12/Jan/2003
--------------------
64 06/Feb/2003
296 07/Feb/2003
4302 08/Feb/2003
3464 09/Feb/2003
12931 10/Feb/2003
12679 11/Feb/2003
16427 12/Feb/2003
2779 13/Feb/2003
3342 14/Feb/2003
386 15/Feb/2003
--------------------

These are just deepcrawl for one large-ish new site.. HTH. :)

webdevsf

11:07 pm on Mar 1, 2003 (gmt 0)

10+ Year Member



I have over 110,000 hits from "freshbot" since mid Feb. This is the a new pattern to me. Usually, I get about 10-50 freshbots, and 50,000 deepbots (over the course of a week).

This bot (64.68.80.x) has been hitting over 10,000 pages a day for almost 2 weeks. I also noticed that the indexes on www2 and www3 are a lot more in flux for my site more often.

This may be because of a pagerank increase in my site (it's only a PR5) but I doubt it. We have very few backlinks (less than 20)

I'm not sure the freshbot/deepbot dichotomy exists anymore... It seems like things are updated more regularly now.

Anyone else seen this new pattern? Googleguy?

Jesse_Smith

11:27 pm on Mar 1, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Most of my new sites had about 175 pages deepcrawled each, but my vBulletin board that was deepcrawled for the first time thanks to dumping the session ID, was deepcrawled atleast 1,500 times!

:::I have over 110,000 hits from "freshbot" since mid Feb.

How do you count that many?! Is there a cgi script that will do the counting?

taxpod

11:36 pm on Mar 1, 2003 (gmt 0)

10+ Year Member



Gbot pulled down more than 200K pages in Feb on one of my sites that usually gets maybe 50-100K in a typical month. Then today, Mar 1, she took another 35K pages. The month started normally with miss deepcrawler pulling down around 45K pages where usually she would take a bit more. Then she came back for more, then freshbot pulled down another 40K, then Deepcrawler from the new IP range came back for a major crawl. Things went silent for maybe a day and then the new range deepcrawler came back and seems to have done another complete crawl.

There's too much volume in here to go through but suffice it to say that from the second of Feb until today, there is roughly two and half times as much activity, if not more, than usual.

My other two sites have seen similar activity.

ncw164x

12:53 am on Mar 2, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Alphawolf

For the last 12 months googlebot always started on the first of the month and does not leave for 8 - 10 days. Other posters pass comment that the dance starts for them around the 20th of the month. February this year googlebot has hit the server every day and spidered a lot more pages than she has every taken (in excess of 20k-25k pages a day) so I can only assume that there are going to be some big changes to all of our site in some way or another. Activity does seem to be double on what it is on a normal month - lets hope it's for the better