Googlebot Indexing Problems

Google only crawls part of a website

[asc_web]

Over the past few months, we see that Googlebot visits our website almost daily, but it only crawls part of our site. Often it only gets robots.txt and default.aspx and usually doesn't do much else.

We have several hundred unique pages and the most we've seen indexed at one time (within a couple days) is less than 10%.

We've been changing things like, adding double quotes around the href="" in our links and replacing postbacks in our aspx pages with plain links.

We do have a site map that links to every page in the site and we've made sure all links on pages have been limited to < 100. We also moved out all javascript that had anything to do with links.

Would anyone have any other suggestions? Any help would be greatly appreciated...

[DerekH]

Welcome to WebmasterWorld asc_web

You say you've added double quotes to your HREFs.

Might I suggest you pop a few pages through the W3C validator and see whether the served code is error-free.

Google for W3C markup validator

There are also spider-eye viewers that will show you what the spider is seeing - quite often that will highlight places where an opportunity to move the spider on has been lost.

Others will have more ideas for you, but this should get you started and is always worth doing whenever you have a new site or a new layout for an existing site.
DerekH

[Jakpot]

Google is in a state of random flux. I would not recommend changing anything on your pages.
Maybe they will get their act together.
Maybe they won't.