Welcome to WebmasterWorld Guest from

Message Too Old, No Replies

Googlebot stopped visiting - does this mean a penalty?



8:00 pm on Apr 6, 2006 (gmt 0)

10+ Year Member

During the 1st week in March Google started to drop my pages from its index and now I have about 1/2 the pages and one half the traffic) that I used to. I don't follow this forum religiously, but it does seem like the pages that were dropped were similar in their construction and perhaps a little too cookie cutter for Googlebot. I have been busy rewriting those pages to see if they will be picked up again, but all of the sudden Googlebot has stopped crawling my site completely. Googlebot has visited my site every day for years, and always shows up within a few days to grab all my pages after I have a major update. This time no Googlebot...does that mean my site has been penalized in some way? Thanks for any advice


9:09 pm on Apr 6, 2006 (gmt 0)

5+ Year Member

You're not alone, many are reporting this same thing.


7:17 am on Apr 7, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member

Yup. After being highly regular and predictable (sitemap fetches twice a day, at nearly exactly the same time), googlebot last visited my site on April 5, 2006, 3:01PM, PDT. Not a single fetch since then. The silence is deafening.


7:21 am on Apr 7, 2006 (gmt 0)

10+ Year Member

I'm experiencing this problem in one site.
Last visit from GGbot is 29th of March.

Patrick Taylor

7:45 am on Apr 7, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member

On the few sites where I'm actively watching Googlebot, 29th March is the day that crawls dropped quite dramatically in all cases. The sites are unrelated, and traffic is still normal.


1:22 pm on Apr 7, 2006 (gmt 0)

10+ Year Member

29th March here too


1:38 pm on Apr 7, 2006 (gmt 0)

WebmasterWorld Senior Member 5+ Year Member

Are these pages changing content a lot? If they are staying the same content wise I would not worry about it. If you never make any changes to the pages, then googlebot is figuring out that it only needs to visit you a few times a month.


2:06 pm on Apr 7, 2006 (gmt 0)

10+ Year Member

Same here... Old Googlebot came regulary, fetched about 1/3 to 1/2 of the site daily but since March 28 the trouble started. Supplemental Index, pages coming back, pages dropping etc...

Google Mozilla Bot spidered the domain more or less completely starting March 24 to April 5... Since that the crawl activity went down ... Last hit (only one page) this night :(

I guess we have to wait until that big daddy stuff has settled... I have a clean conscience with respect to spam so I hope that google will return to its normal crawl cycle in short time.


4:42 pm on Apr 7, 2006 (gmt 0)

WebmasterWorld Senior Member netmeg is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

Two of my client's sites had hundreds if not thousands of pages suddenly go supplemental around March 8, and the Googlebot has slowed crawling WAY down in the past few weeks. Where it used to crawl anywhere from 400 to 1000 pages a day on each site, it's now picking up 30 to 40 - and it's the same 30 or 40 every day. One client has had all his supplementals turn back into normally indexed pages, and that's good - the other one has 50 normal pages, and 12,000 supplementals still. I'm having a real hard time explaining to them that this is just the way it works sometime.


4:49 pm on Apr 7, 2006 (gmt 0)

10+ Year Member

I noticed that one day the number of pages i had indexed doubled, and all of the added pages were old cached pages that were listed as supplemental...the next day they were gone again. Googlebot has not come to visit at all though


5:44 pm on Apr 7, 2006 (gmt 0)

5+ Year Member

maybe Googlebot has gotten lost somewhere, we have not seen him for a couple of days and very little this month. No progress in supplementals either, results showing 345 pages on some db's but only 200+ show up. Page counts are screwed up. Still in supplemental h*ll. Is google sick or dying or what?


6:42 pm on Apr 7, 2006 (gmt 0)

10+ Year Member

Mozilla Googlebot has been busy as heck the past week. But today, everything has ceased.


6:55 pm on Apr 7, 2006 (gmt 0)

5+ Year Member

Yup, same here. Yesterday Gbot was still raining down on my site but it suddenly stopped today and it only hit on my main home page for a couple of times.

Maybe today is Google "Judgement Day" after BD. :)


7:18 pm on Apr 7, 2006 (gmt 0)

10+ Year Member

Wouldn't you know it! In the time it took for me to compose my last post, Mozilla Googlebot is back, and in full force. Now he's trying to index pages that are specifically blocked in robots.txt!

Well, at least it's something. But this whole thing is very odd to me.


9:37 pm on Apr 7, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member

Info on this puzzle at this (almost identical) thread [webmasterworld.com].

Featured Threads

Hot Threads This Week

Hot Threads This Month