Googlebot not visiting index page

but see it sometimes on internal pages

[stickyboy]

Googlebot no longer seems to visit my index page. I see it occasinally on robots.txt and a few internal pages which have inbound links. The thing is I have virtually all inbound links (around a 1000) to my homepage. The toolbar still shows PR6. This has gone on since mid November. Most of my pages are listed as URL only (presume as google is hardly visiting them). What can I do or check why googlebot is not visiting?

[mrMister]

I assume you have an incredibly useful website with lots of content that people find invaluable? Your high page rank is entirely because so many people love your site right and link to it because they think others will find it useful.

Yes, thought so. Hmm, seems odd why this has happened to you, maybe it's just a glitch and it will resolve itself soon.

Usually this kind of thing happens to people who create sites with no content, and fill their site with affiliate links and not much else.

These kind of people buy links, place links on their own sites and sites they have control of. Then they start demading links in return for services offered. Usually these are not even slightly related to the content of their site. It's not suprising that Google catches on to what they're doing after a while.

I'd hold on mate. If your site is of good quality, it'll get more visits soon. Maybe Google's broken. You can be thankful that Google is doing its best to prevent those other rubbish sites from getting high rankings. If you percevere, your high quality site will rise to the top of the SERPs.

[walkman]

same here. Google thinks that our sites are not worth that much /are spammers or whatever google says. The sad part is that I spend hours a day updating the info on my site. Try telling that to a robot. Apparently we have tripped a few of G's filters. Read about G's new patent.

to clarify: my index page gets visited daily, only cached every 10 days or so. Before Nov, I got daily fresh tags

[lost in space]

stickyboy - My site is in the same boat as yours, I have a PR5 site that is over 5 years old and my index page fell out of Google last November. I can't pinpoint the true reason. I did not have a link exchange program when it happened. I revamped the site about 10 times in the past 5 months and still I am out!

I am dying to know if any of the ousted sites from last November recovered. It really sucks not knowing what to to or when to just give up!

[stickyboy]

lost in space - I was hit in November also, sounds exactly the same problem.

[walkman]

"I revamped the site about 10 times in the past 5 months and still I am out!"

I only did it twice, but we made it worst. Google's new patent says that moving pages around, changing filenames, total page numbers etc. are sign of spam sites. We're stuck in a vicious cycle. GoogleGuy, if you're reading this: is it possible to get out of it, provided that whatever G sees as a problem is fixed?

Now, I'm almost done with a new site and will move the older content to an existing, totally non-commercial, site and let it die there, not update. I already banned G from the site to avoid a dupe while th econtent is transfered. I have to do something. Hopefully I get some traffic there.

[lost in space]

Walkman

Did you try contacting Google? I did and 3 times they sent me to read the webmaster guidelines (like I am some black hat SEO criminal).

I follow the darn guidelines... this really isn't fare. I am human and I made some stupid programming mistakes, but to punish a 5 year old site forever isn't right!

Dawn

[walkman]

contacting them is useless, the site has gotten caught in the middle of their wide net. If you're indexed, they will not help you.

[lost in space]

Walkman

Is your whole site tanked? For me it is about 80 % of the site and the index page. The remaining pages still listed are not getting much traffic.

Many of my pages have PR5 and PR6... It took years to get the PR that high. If I start I new site it will take forever to achieve that.

If I 301 redirect to a new site will the penality follow? Will the PR pass to the new site or will that site start out at zero?

Dawna

[GuinnessGuy]

Looks like I'm in the same boat. Got the boot sometime in November. In fact, November 2nd is last cache date of any of our pages. The past two days I've been scrambling to find out what's wrong.

Today I was looking at our code and saw two three different <head> sections in our index page. Apparently Front Page added the <head> sections to our head.asp and foot.asp include files. I was wondering what effect this might have. Could this have confused the bot?

GuinnessGuy

[robotsdobetter]

Today I was looking at our code and saw two three different <head> sections in our index page. Apparently Front Page added the <head> sections to our head.asp and foot.asp include files. I was wondering what effect this might have. Could this have confused the bot?

I doubt that would do it because I have made the same mistake before and Google, Yahoo! and MSN spider my site fine. Spiders are similar to browsers, they read the HTML to display the web page, if your HTML code contains errors, they will try to correct the errors in the HTML code.

[GuinnessGuy]

robotsdobetter,

Thanks for the reply. I guess I'm still getting screwed by a couple of 302 hi-jackers. I got one removed using the urlcontroller in google, but the other one, instead of removing his 302 link just pointed it to some almost empty page in his site. I stuck a link up to that site from a highly crawled other domain and google's cache of that page now reflects *his* page's contents and not my index page. However, he still shows up using the site command. His entry is supplemental and can only be found clicking on the omitted results. I'm surprised that his page shows there at all considering that Google has spidered it. I guess this all takes some time for Google to sort out....:(

Another thing I'm wondering about is whether google thinks there is no new content to spider. Could something be set up wrong on the web server to cause this? There is another site on that server with exactly the same last cache date(back in November). Strange...

Question: If googlebot comes to check for new content, will it show up in my logs? Or will it only show if it crawls the page? Never do I see googlebot in the logs for my index page.

GuinnessGuy

[stickyboy]

my site has been pretty much dipped in google bit time since November. Have noticed that when I do allinurl command a site called worldlingo comes up

www.worldlingo.com/wl/translate?wl_url=http:/ /www.mydomain.co.uk&wl_qopt=0

with a translastion of my page into English....well its in English anyway and there site is a pr8 (mine a pr6) is this likely my site got dropped as the cached of that page is November as well. The World Lingo page appears as supplemental.If this is a problem what can i do to get rid of it?

[Reid]

Thats funny you mention english translated into english.

I got a new referrer in my logs that I have not filtered into a hostname.
After checking it out it is Google (english)
the page cache it is associated with has spanish in the frame part "google is not associated with this page if you would like to view this page" that's all spanish.
So it seems that when a person from another language asks for 'english' they do not just get google.com, instead they get
[64.233.161.104...]

<edit in> notice the PR? google.com is PR9 this one is PR0 is this a new page?

[Reid]

they changed it
I like the DaVinci theme but it's not the ole' 'lifesavers' that we've all come to love.

Still thats the Google(english) page. Notice the link 'goto google.com'