Forum Moderators: open

Message Too Old, No Replies

Titles and description mission on allinurl

         

Auradefect

9:03 pm on Jun 30, 2003 (gmt 0)

10+ Year Member



I'm not sure if this was covered recently but when I do an allinurl search for my site I get about 6 pages of good results but then once i hit the 7th page all the way to the end im getting results that look similar to this:

www.sitesurl.com/product.asp?3=114
Similar pages

www.sitesurl.com/product.asp?3=115
Similar pages

It goes on and on until the end.
They are all missing a title and description.
Anyone know anything about this?

vincevincevince

9:52 pm on Jun 30, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



normally means they couldn't be crawled (but were there before) - normally that will be deleted pages - google seems to remove the description after an unsuccessful crawl and return, and then in further time, it will remove the page all together

Auradefect

10:36 pm on Jun 30, 2003 (gmt 0)

10+ Year Member



These pages do exist though. They represent the bulk of my site. Could this mean my site was down during the last deepcrawl?

Harwich

5:01 pm on Jul 1, 2003 (gmt 0)

10+ Year Member



Is it possible that the bot had a problem crawling them because they are dynamic? I have the same issue with my site, I just changed it so that my dynamic pages (all of them) will look like a static address. I am hoping it will help.

takagi

5:12 pm on Jul 1, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



It just means that a link was found to the page, but no data is available to display title, snippet, file size, etc. (unless it is a page in ODP/Google Directory in which case a title and description will be shown).

The reason can be all kinds:
1. Bot is not allowed (robots.txt, META tag, etc)
2. Server was down when bot wanted to spider the page
3. Google ran out of time to spider the page before the index was made
4. Some other reason

Those pages with only a URL in the SERP will soon get a title and snippet if your home page has a decent PR, the site doesn't consist of a lot of pages, and there is no reason to skip those pages.

Harwich

5:31 am on Jul 2, 2003 (gmt 0)

10+ Year Member



Guess I am out of luck. My home page still has PR0 and the site is fairly large.

jdMorgan

5:46 am on Jul 2, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



takagi,

Not to divert this thread... I just wanted to mention that this is a classic Google listing for pages which have been disallowed in robots.txt. If the page is allowed by robots.txt, but has a meta robots noindex tag, then Google will index (fetch) it, but not list it at all in their SERPs. This is actually my work-around for the fact that Google will list any page it finds a link to; I just allow it in robots.txt, and then use the noindex tag on the page.

However, back on the subject of this thread, I agree that no-title-no-description means a link to the page was found, but the page was not crawled for some reason.

Jim