Forum Moderators: open
www.sitesurl.com/product.asp?3=114
Similar pages
www.sitesurl.com/product.asp?3=115
Similar pages
It goes on and on until the end.
They are all missing a title and description.
Anyone know anything about this?
The reason can be all kinds:
1. Bot is not allowed (robots.txt, META tag, etc)
2. Server was down when bot wanted to spider the page
3. Google ran out of time to spider the page before the index was made
4. Some other reason
Those pages with only a URL in the SERP will soon get a title and snippet if your home page has a decent PR, the site doesn't consist of a lot of pages, and there is no reason to skip those pages.
Not to divert this thread... I just wanted to mention that this is a classic Google listing for pages which have been disallowed in robots.txt. If the page is allowed by robots.txt, but has a meta robots noindex tag, then Google will index (fetch) it, but not list it at all in their SERPs. This is actually my work-around for the fact that Google will list any page it finds a link to; I just allow it in robots.txt, and then use the noindex tag on the page.
However, back on the subject of this thread, I agree that no-title-no-description means a link to the page was found, but the page was not crawled for some reason.
Jim