This months Googlebot

Anybody else notice a leaner crawl this month?

[Paully]

I am noticing about 50% less pages requested by googlebot, and it seems to have completed its monthly stay at my site.

Anybody else notice this?

[mack]

It's been hitting me pretty hard over the past three days. going pretty deep too. Been a while since I got a good deep crawl from GG

[Air]

>Anybody else notice this?

I am noticing the opposite actually, had more visits from Googlebot during/since the update than usual.

[Paully]

I have been getting alot of visits, but she has been slow at getting pages, and the quantity has been less.

The site has been up and running fine, only thing I can think of is: I was getting hit extreamly hard by "LinksManager" about the same time as Googlebot, for a few hours. When I finally saw the logs, I blocked LinksManager, but I wonder if that sucker cost me 1000's of pages!

Hope she comes back for some more...

[edited by: Paully at 2:45 am (utc) on Oct. 8, 2002]

[keyplyr]

Just the opposite. Crawled completely almost every day now.

[vitaplease]

more intense spidering than before for me [webmasterworld.com]

[martin]

A lot more crawl for me and just a few fresh.

[Paully]

Looks like shes still visiting. I will keep my fingers crossed.

[dcheney]

Showing just under 17k pages so far this month - right on target.

[kiwi webmaster]

Googlebot has been very busy on my site too.
I've found that the daily bot crawls almost all the site's 90 pages.
Way to go Google!

[warmasol]

The freshbot crawl much more than before, but the deepcrawler crawls only 60%.

[bether2]

Was getting deep crawling from both the "fresh" bot and the "deep spidering" bot for about 3 days or so until today.

Now the fresh bot is back to it's usual light routine. And the deep bot looks like it might be hitting my page from links on other sites.

I have some external links where I happened to use different combinations of upper and lower case for the URL than I use on my site-specific URL's. I see googlebot hitting the pages using the URL's with the different combos. So I'm guessing that this means it's following links from those other sites.

Uh, I hope I'm making sense here.

Beth

[WebGuerrilla]

I'm with Air on this one.

I've got one site that I can't get Google out of. I've even put up a temp. 403, but they keep on knockin' at the door.

All in all, much more agressive this month.

[martinibuster]

All over me like fleas on a junkyard dog.