Search Engine Indexing

Google and Yahoo not indexing all pages

[grahamr3]

Hi,
We have recently had a website professionally optimized. It seems that MSN has indexed the majority of the 22 pages but Google and Yahoo have indexed only two of the pages. Any ideas on how to prompt these robots to index the rest of the site.

[tedster]

There's only one solid way -- more inbound links and patience. Google especially has been pre-occupied lately, devoting a lot of resources to rolling out their new "Big Daddy" infrastructure. At least you know that your site CAN be crawled, since MSN did it.

In the old days, navigating your site with the toolbar installed seemed to bring Googlebot running, but not so much now. Particpating in Google's Sitemap Program [google.com] might be helpful -- you'll definitely ghet feedback about any problems they encounter trying to crawl your site -- no guaranteed on indexing, butr it sure doesn't hurt.

And Slurp is usually attentive, but it can be slow to make the deeper crawl. MSNbot is just crawling crazy right now. Sometimes I think they rebuild the entire index from scratch every 30 days, but that just can't be true, can it?