homepage Welcome to WebmasterWorld Guest from
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Pubcon Platinum Sponsor 2014
Home / Forums Index / Google / Google News Archive
Forum Library, Charter, Moderator: open

Google News Archive Forum

No Gbot activity for 3 weeks
Any suggestions

 11:23 pm on Oct 16, 2003 (gmt 0)

I have not had a Gbot visit in about 3 weeks although my serps and backlinks remain unchanged (on all datacenters). As far as I know my site is very clean and was getting visited almost daily. Gbot activity seems to have stopped. I would appreciate any help in trying to remedy this problem. Thanks



 12:43 am on Oct 17, 2003 (gmt 0)

On one site I'm geting deepcrawled daily, and on another site, a new site, I was last deepcrawled on October 8th.


 12:49 am on Oct 17, 2003 (gmt 0)

This isn't a new site. It's just over a year old - completely non-commercial - just informational. The site validates and has good incoming links, but something must be up to have no activity for such a long period of time. Pr remains constant as do serps. I'm just totally lost as to what might have happened to cause the GBot to disappear. I'd assume if I was penalized my site's serps would be dropping (which isn't the case) or my PR would have been affected.


 1:15 am on Oct 17, 2003 (gmt 0)

Try sacrificing a virgin to the Google Gods. May not work, but worth a try. ;) With my sites getting harassed by Googlebot daily has long been the norm. I used to be paranoid about this meaning Google didn't trust me. From what I've seen from logs of other sites, it appears that Googlebot is just way to overzealous with spidering.


 1:52 am on Oct 17, 2003 (gmt 0)

>Try sacrificing a virgin to the Google Gods: Would you care to elaborate a bit more? I've written to help@google.com just a few hours ago but I don't expect a reply anytime soon if at all. Thanks RF


 2:29 am on Oct 17, 2003 (gmt 0)

>Would you care to elaborate a bit more?

#1) Find an actual virgin female. I know in this day and age easier said than done, but possible.

#2) On an altar, kill her while chanting prayers to the Google Gods.

I'll concede that this probably won't work. However, there were actual religions in days gone by that did this when things went bad, hoping to please their gods. I've heard rumors that some Chicago Cubs fans may resort to virgin sacrifice, as everything else has failed to bring the team success. ;)


 2:39 am on Oct 17, 2003 (gmt 0)

Well RF - that as you mentioned in these days is almost impossible to do, but thanks for the laugh. I thought you might have a magic potion in mind - heck a true virgin would be magic these days. Guess all I can do is sit and wait it out - there surely is no reason I can find for the GBot behavior, but then again if I knew the answer to that one I wouldn't have posted to start with. I wonder how many of us go to our SHRINKS due to Google woes. Thanks again. You've always been most helpful.


 2:46 am on Oct 17, 2003 (gmt 0)

Solution: find a website with a good page rank, say 5 or 6 that is still getting freshbotted. Have them put a nice juicy text link to your site on the page that gets the freshbot. Then wait a few days.


 3:01 am on Oct 17, 2003 (gmt 0)

I've written to help@google.com just a few hours ago but I don't expect a reply anytime soon if at all

I hesitate to say this because i would'nt want everyone to rush off to email google, but...
The customer service at G has often impressed me. Last week i sent them a question about possible spider problems and recieved an e-mail response within the same day, directly addressing the issue. I noticed in the log files for the particular site, that one of the g bots paid a "test" visit.
Coosblues... don't worry yet. Lots of things going on with the bots these days, including google. Get back to work and let the bots work it out, they will.


 4:00 am on Oct 17, 2003 (gmt 0)

odb... I was impressed with the google email support also. I was actually very surprised when one of my requests was addressed exactly and completely.

Mine was actually and adsense issue but being so used to bad online support (not from google) I was expecting a form letter that somewhat touched on one of my issues. Instead I found that someone actually read and considered each point. The answers weren't what I was hoping they would be but they were the right answers for my questions.

I followed up with a seperate email of praise for the good work.

Sorry for being sortta OT but hey.. they made a fan out of me.



 8:28 pm on Oct 17, 2003 (gmt 0)


1- How many pr at index page? low pr pages can take three weeks to be revisited.
2- Did you carefully check your logs and all foolish things like disallow: / in robots.txt?


 10:36 pm on Oct 17, 2003 (gmt 0)

>Gus R - My index page is a 5 and I have a few pr5 sites with reciprocal links (which are getting a fresh date). I have no robots.txt file or any meta tags disallowing spidering. I was getting freshed every few days until 3 weeks ago and I have not made any major changes other than keeping things up-to-date.


 11:02 pm on Oct 17, 2003 (gmt 0)

Since you "keep things upto date" you may want to run an html validator on your pages to see if for some reason one of your updates made your pages unreadable... dunno just a guess (with limited information)

i suggest getting tidy or using [searchengineworld.com...]

good luck!


 11:15 pm on Oct 17, 2003 (gmt 0)

Sorry dude but you probably need a higher PR site to get Googlebot to visit more often.

Problem is that high PR can't be had without links from high PR sites and Google can't seem to get around to updating the links either.....

Maybe the virgin sacrifice would be easier!


 11:19 pm on Oct 17, 2003 (gmt 0)

Everything validates - I've always made sure of that and anytime I update a page I validate it using the W3C validator. I'm really not so concerned about the fresh dates - more concerned that I haven't received some sort of penality. As mentioned before, Pr and backlinks remain stable. Thanks everyone


 12:44 am on Oct 18, 2003 (gmt 0)

Ok, I've one pr4 with fresh tags everyday.

What about other spiders?

I still think three weeks is too early to worry though no freshbot for a pr5 (?)

Recently there was a thread where host admin banned googlebot!

DNS problem?

(If you are in virtual hosting) what about the others at same ip, still with fresh tags?

Really guessing.

(added: penalized site gets spidering like a good one)


 1:58 am on Oct 18, 2003 (gmt 0)

I read the thread about the host banning Gbot - I checked my hosts robots.txt file and found nothing of concern there. Not sure about the DNS - don't even know where to begin to troubleshoot that one. Thanks again


 2:22 am on Oct 18, 2003 (gmt 0)

Just want to thank you all for your help. I just received a reply from google at help@google.com with the following exerpt"
Thank you for your note. Your site is currently in the index and should be
visited during the next crawl." Thanks to Google for being so prompt also. I just wrote them about 24 hours ago and to get a quick reply like that further shows that Google does care and is there to help the serious webmasters (that follow the TOS). I guess my shrink won't been getting a "Google visit" from me this week.


 6:17 pm on Oct 18, 2003 (gmt 0)

As mentioned before, Pr and backlinks remain stable.

This could be it. I have noticed several times that getting more backlinks seems to attract Googlebots, as if some of them really play the random surfer arbitrarily following links.

Global Options:
 top home search open messages active posts  

Home / Forums Index / Google / Google News Archive
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved