Googlebot still crunching?

yum yum yum

[AhmedF]

Hrmm ... Just checking my stats, and googlebot has visited my site 140 times in just 12 hours of this month ...

Is even the march 3rd guess too optimistic now?

[AcesHigh]

March 3rd STRONG believer here.

[Dieter]

Where do you check your stats to see that Googlebot has visited your site?

[bhartzer]

Take a look at your log files for your site and you should be able to tell. Google disguises itself as 'googlebot'.

[Dieter]

Thanks bhartzer - where do I find the log files to my site? Is that the log from a Counter program, or is it something else?

[jdMorgan]

Dieter,

Welcome to WebmasterWorld [webmasterworld.com]!

The location of your log files would depend on how your hosting service has your account configured. I would recoomend that you check their FAQs, or contact their customer service department.

Jim

[markusf]

Googlebot just hit me a few min ago...
Freshbot?
64.68.82.39
64.68.82.18
64.68.82.5

[troels nybo nielsen]

Welcome to WebmasterWorld, markusf.

Meet one of our Google experts and read one of his classics: [webmasterworld.com...]

[webdevsf]

I think deepbot finished yesterday (March 1). Bring on the update!

[AhmedF]

Ive had 850 pages indexed by googlebot THIS month already!

Come on update! :-/

[Rick_M]

I have not noticed the deep crawler since Feb 16. Today I've had a ton of traffic from the freshbot though, spidering a huge chunk of my sites.

[Night_Hawk]

And still going,

I got about 76 hit from googlebot today.

[DerekT]

During this deepcrawl GoogleBot had indexed over 60,000 pages over a period of 5 days. Then a few days of no activity. Then another 500 pages. A few days more of inactivity. Then last night an additional 3000 pages indexed. Very strange activity.

[Jesse_Smith]

:::Then last night an additional 3000 pages indexed.

Is he showing up under 216.239.46.** or 64.68.82.**? The deepcrawl ended on about the 15th of last month.

216 is deepcrawl and 64 is the freshbot.

[DerekT]

My logs roll over every hour since they get large very quickly. I was unable to find out what bot was crawling last night. Wouldn't It would be strange for freshbot to crawl that many pages?

[kelleybelly]

Has the deep crawl happened yet. I have not seen google spidering my site and I have been watching like a Hawk? How long will it be before I see the updates from last months deep crawl?

[Jesse_Smith]

Dppecrawl doesn't start until after the dance ends and lasts about 10 days.

:::Wouldn't It would be strange for freshbot to crawl that many pages?

Nope, not at all. Some of us get thousands of hits a day from the freshbot.

:::How long will it be before I see the updates from last months deep crawl?

When we start barking up the wall then you can be sure you can see them, er wait we are allready barking up the wall! The next dance will show the updates from last months deepcrawl.

[wired4fun]

I, too, got hit by freshbot for over 50k pages.
First time that many pages in one day.

No sign of deepbot this month.

The funny thing is that freshbot is crawling
ten's of thousands of pages that are disallowed
in the robots.txt file. Anyone else seen this
happen recently?