homepage Welcome to WebmasterWorld Guest from 54.205.241.107
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Pubcon Platinum Sponsor 2014
Home / Forums Index / Google / Google SEO News and Discussion
Forum Library, Charter, Moderators: Robert Charlton & aakk9999 & brotherhood of lan & goodroi

Google SEO News and Discussion Forum

    
Googlebot stopped visiting - does this mean a penalty?
ichthyous

10+ Year Member



 
Msg#: 33806 posted 8:00 pm on Apr 6, 2006 (gmt 0)

During the 1st week in March Google started to drop my pages from its index and now I have about 1/2 the pages and one half the traffic) that I used to. I don't follow this forum religiously, but it does seem like the pages that were dropped were similar in their construction and perhaps a little too cookie cutter for Googlebot. I have been busy rewriting those pages to see if they will be picked up again, but all of the sudden Googlebot has stopped crawling my site completely. Googlebot has visited my site every day for years, and always shows up within a few days to grab all my pages after I have a major update. This time no Googlebot...does that mean my site has been penalized in some way? Thanks for any advice

 

freewebsiteideas

5+ Year Member



 
Msg#: 33806 posted 9:09 pm on Apr 6, 2006 (gmt 0)

You're not alone, many are reporting this same thing.

ronburk

WebmasterWorld Senior Member 10+ Year Member



 
Msg#: 33806 posted 7:17 am on Apr 7, 2006 (gmt 0)

Yup. After being highly regular and predictable (sitemap fetches twice a day, at nearly exactly the same time), googlebot last visited my site on April 5, 2006, 3:01PM, PDT. Not a single fetch since then. The silence is deafening.

dino2004

5+ Year Member



 
Msg#: 33806 posted 7:21 am on Apr 7, 2006 (gmt 0)

I'm experiencing this problem in one site.
Last visit from GGbot is 29th of March.

Patrick Taylor

WebmasterWorld Senior Member 10+ Year Member



 
Msg#: 33806 posted 7:45 am on Apr 7, 2006 (gmt 0)

On the few sites where I'm actively watching Googlebot, 29th March is the day that crawls dropped quite dramatically in all cases. The sites are unrelated, and traffic is still normal.

ichthyous

10+ Year Member



 
Msg#: 33806 posted 1:22 pm on Apr 7, 2006 (gmt 0)

29th March here too

trinorthlighting

WebmasterWorld Senior Member 5+ Year Member



 
Msg#: 33806 posted 1:38 pm on Apr 7, 2006 (gmt 0)

Are these pages changing content a lot? If they are staying the same content wise I would not worry about it. If you never make any changes to the pages, then googlebot is figuring out that it only needs to visit you a few times a month.

Dawg

5+ Year Member



 
Msg#: 33806 posted 2:06 pm on Apr 7, 2006 (gmt 0)

Same here... Old Googlebot came regulary, fetched about 1/3 to 1/2 of the site daily but since March 28 the trouble started. Supplemental Index, pages coming back, pages dropping etc...

Google Mozilla Bot spidered the domain more or less completely starting March 24 to April 5... Since that the crawl activity went down ... Last hit (only one page) this night :(

I guess we have to wait until that big daddy stuff has settled... I have a clean conscience with respect to spam so I hope that google will return to its normal crawl cycle in short time.

netmeg

WebmasterWorld Senior Member netmeg us a WebmasterWorld Top Contributor of All Time 5+ Year Member Top Contributors Of The Month



 
Msg#: 33806 posted 4:42 pm on Apr 7, 2006 (gmt 0)

Two of my client's sites had hundreds if not thousands of pages suddenly go supplemental around March 8, and the Googlebot has slowed crawling WAY down in the past few weeks. Where it used to crawl anywhere from 400 to 1000 pages a day on each site, it's now picking up 30 to 40 - and it's the same 30 or 40 every day. One client has had all his supplementals turn back into normally indexed pages, and that's good - the other one has 50 normal pages, and 12,000 supplementals still. I'm having a real hard time explaining to them that this is just the way it works sometime.

ichthyous

10+ Year Member



 
Msg#: 33806 posted 4:49 pm on Apr 7, 2006 (gmt 0)

I noticed that one day the number of pages i had indexed doubled, and all of the added pages were old cached pages that were listed as supplemental...the next day they were gone again. Googlebot has not come to visit at all though

Wally_Books

5+ Year Member



 
Msg#: 33806 posted 5:44 pm on Apr 7, 2006 (gmt 0)

maybe Googlebot has gotten lost somewhere, we have not seen him for a couple of days and very little this month. No progress in supplementals either, results showing 345 pages on some db's but only 200+ show up. Page counts are screwed up. Still in supplemental h*ll. Is google sick or dying or what?

catch2948

10+ Year Member



 
Msg#: 33806 posted 6:42 pm on Apr 7, 2006 (gmt 0)

Mozilla Googlebot has been busy as heck the past week. But today, everything has ceased.

Porter5Forces

5+ Year Member



 
Msg#: 33806 posted 6:55 pm on Apr 7, 2006 (gmt 0)

Yup, same here. Yesterday Gbot was still raining down on my site but it suddenly stopped today and it only hit on my main home page for a couple of times.

Maybe today is Google "Judgement Day" after BD. :)

catch2948

10+ Year Member



 
Msg#: 33806 posted 7:18 pm on Apr 7, 2006 (gmt 0)

Wouldn't you know it! In the time it took for me to compose my last post, Mozilla Googlebot is back, and in full force. Now he's trying to index pages that are specifically blocked in robots.txt!

Well, at least it's something. But this whole thing is very odd to me.

AlexK

WebmasterWorld Senior Member 10+ Year Member



 
Msg#: 33806 posted 9:37 pm on Apr 7, 2006 (gmt 0)

Info on this puzzle at this (almost identical) thread [webmasterworld.com].

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Google / Google SEO News and Discussion
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved