Welcome to WebmasterWorld Guest from

Forum Moderators: open

Message Too Old, No Replies

Puzzling "deep crawl"

One page at a time?

10:45 pm on Jun 30, 2002 (gmt 0)

Senior Member

WebmasterWorld Senior Member steveb is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:June 20, 2002
votes: 0

Googlebot visits my site every day, taking 1.2 pages most every day (I have no clue how that is possible, but that is what my lame-o urchin logs say.)

Two days ago Googlebot came and took 91 pages, and then ten more yesterday, but... my logs show all these as different visitors -- 91 visits from Googlebot, rather than one visit with 91 pageviews.

I would guess this is just my lame-o statistics being lame, but is this the standard way Google shows up in logs - as 91 visitors when it views 91 pages?

10:51 pm on June 30, 2002 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:May 13, 2002
votes: 0

Google has multiple IP addresses, so each hit comes in as a new visitor.


1:40 am on July 1, 2002 (gmt 0)

Junior Member

10+ Year Member

joined:May 26, 2002
votes: 0


Using Urchin, go into the Browsers¦Browser Tree section.

You'll see googlebot in the list. Multiply the googlebot visitors number by pages/visitor and you'll get a pretty good idea how many times it hit your site during that time period.