Welcome to WebmasterWorld Guest from 23.22.220.37

Forum Moderators: open

Message Too Old, No Replies

No Gbot activity for 3 weeks

Any suggestions

     
11:23 pm on Oct 16, 2003 (gmt 0)

Full Member

10+ Year Member

joined:Oct 19, 2002
posts:308
votes: 0


I have not had a Gbot visit in about 3 weeks although my serps and backlinks remain unchanged (on all datacenters). As far as I know my site is very clean and was getting visited almost daily. Gbot activity seems to have stopped. I would appreciate any help in trying to remedy this problem. Thanks
12:43 am on Oct 17, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Feb 5, 2003
posts:807
votes: 0


On one site I'm geting deepcrawled daily, and on another site, a new site, I was last deepcrawled on October 8th.
12:49 am on Oct 17, 2003 (gmt 0)

Full Member

10+ Year Member

joined:Oct 19, 2002
posts:308
votes: 0


This isn't a new site. It's just over a year old - completely non-commercial - just informational. The site validates and has good incoming links, but something must be up to have no activity for such a long period of time. Pr remains constant as do serps. I'm just totally lost as to what might have happened to cause the GBot to disappear. I'd assume if I was penalized my site's serps would be dropping (which isn't the case) or my PR would have been affected.
1:15 am on Oct 17, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member rfgdxm1 is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:May 12, 2002
posts:4479
votes: 0


Try sacrificing a virgin to the Google Gods. May not work, but worth a try. ;) With my sites getting harassed by Googlebot daily has long been the norm. I used to be paranoid about this meaning Google didn't trust me. From what I've seen from logs of other sites, it appears that Googlebot is just way to overzealous with spidering.
1:52 am on Oct 17, 2003 (gmt 0)

Full Member

10+ Year Member

joined:Oct 19, 2002
posts:308
votes: 0


>Try sacrificing a virgin to the Google Gods: Would you care to elaborate a bit more? I've written to help@google.com just a few hours ago but I don't expect a reply anytime soon if at all. Thanks RF
2:29 am on Oct 17, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member rfgdxm1 is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:May 12, 2002
posts:4479
votes: 0


>Would you care to elaborate a bit more?

#1) Find an actual virgin female. I know in this day and age easier said than done, but possible.

#2) On an altar, kill her while chanting prayers to the Google Gods.

I'll concede that this probably won't work. However, there were actual religions in days gone by that did this when things went bad, hoping to please their gods. I've heard rumors that some Chicago Cubs fans may resort to virgin sacrifice, as everything else has failed to bring the team success. ;)

2:39 am on Oct 17, 2003 (gmt 0)

Full Member

10+ Year Member

joined:Oct 19, 2002
posts:308
votes: 0


Well RF - that as you mentioned in these days is almost impossible to do, but thanks for the laugh. I thought you might have a magic potion in mind - heck a true virgin would be magic these days. Guess all I can do is sit and wait it out - there surely is no reason I can find for the GBot behavior, but then again if I knew the answer to that one I wouldn't have posted to start with. I wonder how many of us go to our SHRINKS due to Google woes. Thanks again. You've always been most helpful.
2:46 am on Oct 17, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Apr 6, 2003
posts:2523
votes: 0


Solution: find a website with a good page rank, say 5 or 6 that is still getting freshbotted. Have them put a nice juicy text link to your site on the page that gets the freshbot. Then wait a few days.
3:01 am on Oct 17, 2003 (gmt 0)

Junior Member

10+ Year Member

joined:July 18, 2003
posts:167
votes: 0


I've written to help@google.com just a few hours ago but I don't expect a reply anytime soon if at all

I hesitate to say this because i would'nt want everyone to rush off to email google, but...
The customer service at G has often impressed me. Last week i sent them a question about possible spider problems and recieved an e-mail response within the same day, directly addressing the issue. I noticed in the log files for the particular site, that one of the g bots paid a "test" visit.
Coosblues... don't worry yet. Lots of things going on with the bots these days, including google. Get back to work and let the bots work it out, they will.
4:00 am on Oct 17, 2003 (gmt 0)

New User

10+ Year Member

joined:Feb 18, 2003
posts:34
votes: 0


odb... I was impressed with the google email support also. I was actually very surprised when one of my requests was addressed exactly and completely.

Mine was actually and adsense issue but being so used to bad online support (not from google) I was expecting a form letter that somewhat touched on one of my issues. Instead I found that someone actually read and considered each point. The answers weren't what I was hoping they would be but they were the right answers for my questions.

I followed up with a seperate email of praise for the good work.

Sorry for being sortta OT but hey.. they made a fan out of me.

--q

8:28 pm on Oct 17, 2003 (gmt 0)

Junior Member

10+ Year Member

joined:May 29, 2003
posts:166
votes: 0


coosblues

1- How many pr at index page? low pr pages can take three weeks to be revisited.
2- Did you carefully check your logs and all foolish things like disallow: / in robots.txt?

10:36 pm on Oct 17, 2003 (gmt 0)

Full Member

10+ Year Member

joined:Oct 19, 2002
posts:308
votes: 0


>Gus R - My index page is a 5 and I have a few pr5 sites with reciprocal links (which are getting a fresh date). I have no robots.txt file or any meta tags disallowing spidering. I was getting freshed every few days until 3 weeks ago and I have not made any major changes other than keeping things up-to-date.
11:02 pm on Oct 17, 2003 (gmt 0)

Junior Member

10+ Year Member

joined:May 18, 2002
posts:126
votes: 0


Since you "keep things upto date" you may want to run an html validator on your pages to see if for some reason one of your updates made your pages unreadable... dunno just a guess (with limited information)

i suggest getting tidy or using [searchengineworld.com...]

good luck!

11:15 pm on Oct 17, 2003 (gmt 0)

Full Member

10+ Year Member

joined:Apr 25, 2003
posts:324
votes: 0


Sorry dude but you probably need a higher PR site to get Googlebot to visit more often.

Problem is that high PR can't be had without links from high PR sites and Google can't seem to get around to updating the links either.....

Maybe the virgin sacrifice would be easier!

11:19 pm on Oct 17, 2003 (gmt 0)

Full Member

10+ Year Member

joined:Oct 19, 2002
posts:308
votes: 0


Everything validates - I've always made sure of that and anytime I update a page I validate it using the W3C validator. I'm really not so concerned about the fresh dates - more concerned that I haven't received some sort of penality. As mentioned before, Pr and backlinks remain stable. Thanks everyone
12:44 am on Oct 18, 2003 (gmt 0)

Junior Member

10+ Year Member

joined:May 29, 2003
posts:166
votes: 0


Ok, I've one pr4 with fresh tags everyday.

What about other spiders?

I still think three weeks is too early to worry though no freshbot for a pr5 (?)

Recently there was a thread where host admin banned googlebot!

DNS problem?

(If you are in virtual hosting) what about the others at same ip, still with fresh tags?

Really guessing.

(added: penalized site gets spidering like a good one)

1:58 am on Oct 18, 2003 (gmt 0)

Full Member

10+ Year Member

joined:Oct 19, 2002
posts:308
votes: 0


I read the thread about the host banning Gbot - I checked my hosts robots.txt file and found nothing of concern there. Not sure about the DNS - don't even know where to begin to troubleshoot that one. Thanks again
2:22 am on Oct 18, 2003 (gmt 0)

Full Member

10+ Year Member

joined:Oct 19, 2002
posts:308
votes: 0


Just want to thank you all for your help. I just received a reply from google at help@google.com with the following exerpt"
Thank you for your note. Your site is currently in the index and should be
visited during the next crawl." Thanks to Google for being so prompt also. I just wrote them about 24 hours ago and to get a quick reply like that further shows that Google does care and is there to help the serious webmasters (that follow the TOS). I guess my shrink won't been getting a "Google visit" from me this week.
6:17 pm on Oct 18, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:July 28, 2003
posts:925
votes: 0


As mentioned before, Pr and backlinks remain stable.

This could be it. I have noticed several times that getting more backlinks seems to attract Googlebots, as if some of them really play the random surfer arbitrarily following links.