Welcome to WebmasterWorld Guest from

Forum Moderators: open

Message Too Old, No Replies

Puzzling "deep crawl"

One page at a time?



10:45 pm on Jun 30, 2002 (gmt 0)

WebmasterWorld Senior Member steveb is a WebmasterWorld Top Contributor of All Time 10+ Year Member

Googlebot visits my site every day, taking 1.2 pages most every day (I have no clue how that is possible, but that is what my lame-o urchin logs say.)

Two days ago Googlebot came and took 91 pages, and then ten more yesterday, but... my logs show all these as different visitors -- 91 visits from Googlebot, rather than one visit with 91 pageviews.

I would guess this is just my lame-o statistics being lame, but is this the standard way Google shows up in logs - as 91 visitors when it views 91 pages?


10:51 pm on Jun 30, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member

Google has multiple IP addresses, so each hit comes in as a new visitor.



1:40 am on Jul 1, 2002 (gmt 0)

10+ Year Member


Using Urchin, go into the Browsers¦Browser Tree section.

You'll see googlebot in the list. Multiply the googlebot visitors number by pages/visitor and you'll get a pretty good idea how many times it hit your site during that time period.


Featured Threads

Hot Threads This Week

Hot Threads This Month