Welcome to WebmasterWorld Guest from 54.157.222.62

Message Too Old, No Replies

Why most of my indexed pages in Google does not have any description?

Indexing problem!

   
12:04 pm on Jan 31, 2005 (gmt 0)

10+ Year Member



Hi folk,
I noticed in the last 3 months that google indexes most of my pages as just links without have any description or tile or even do not cashed?! Please help.

Regards.

8:20 pm on Feb 2, 2005 (gmt 0)

10+ Year Member



Hi Etarwin

A url only listing usually indicates that Gbot knows that the page exists and theoretically should at a future date index the page.

If the pages are not new I would suggest;

1. check your robots txt to see if gbot has been disallowed
2. check your meta tags for the same
3. make sure there no seesion cookies are being used as this can prevent gbo from indexing your site

8:56 pm on Feb 3, 2005 (gmt 0)

10+ Year Member



I've noticed the following through experimentation:
I was tracking Google's indexing of a subsection of my site, and periodically some listings would "downgrade" to just a URL, losing the snippet and page title. After I removed the NOARCHIVE attribute from those pages, Google's indexing of them became more reliable and it no longer seemed to turn listings into URL-only listings.

That may be purely coincidental, of course...

11:01 pm on Feb 3, 2005 (gmt 0)

10+ Year Member



Check your robots.txt AND if you do not have the robots.txt file, check if your 404 pages really return 404 code.
12:03 am on Feb 4, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



"Why most of my indexed pages in Google does not have any description?"

Evidently so, by your question and many others, it is because Google is no longer functioning correctly.

8:18 pm on Feb 5, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Google said no title in the URL could mean:

"getting dropped for particular keywords,"

I wonder what this means? Too high keyword density or spamming meta tags perhaps?

4:34 pm on Feb 9, 2005 (gmt 0)

10+ Year Member



Does no one else have this problem?
5:08 pm on Feb 9, 2005 (gmt 0)

10+ Year Member



I do. One of my sites has exactly the same problem as you descrbed. Fully indexed pages got nothing but a url. all snipets are gone. Google's referal dropped from 300/day to 30/day. Site traffic dropped in half. :(
7:49 pm on Feb 9, 2005 (gmt 0)

10+ Year Member



>it is because Google is no longer functioning correctly.

Are you seroius?! It is not reasonable!

7:54 pm on Feb 9, 2005 (gmt 0)

10+ Year Member



>1. check your robots txt to see if gbot has been disallowed
>2. check your meta tags for the same
>3. make sure there no seesion cookies are being used as this can prevent gbo from indexing your site

Every thing is fine, no one of the above cases appeared to me!

I noticed this case for most dynamic sites that have a url like the following format:
www.sitename.com/pagename.asp?id=8764

4:44 am on Feb 13, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I just discovered this problem too. It's on a site for a non-profit organization which was doing fine for over a year, and all of a sudden the home page (with a PR5) has nothing showing but a URL. No site outtage, no robot.txt at all, nothing spiffy in the headers. Ironically many of the subpages are indexed just fine, although none of them seem to be coming up under searches for titles, content, etc. Seems like a penalty, but no idea why.
5:21 am on Feb 13, 2005 (gmt 0)

10+ Year Member



Google has always used my meta discription and H1 and H2 in the results. But since this last update the H tags have disappeared. Is this a sign that the h1 tags are not as important as they used to be?
11:34 am on Feb 13, 2005 (gmt 0)

10+ Year Member



I think Google created new plan by decreasing the storage size on their servers.
11:44 am on Feb 13, 2005 (gmt 0)

10+ Year Member



I remember I contacted them and they told me that google bot do not navigate in my site for some reasons.
11:53 am on Feb 13, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I had exactly this with two of my sites before Christmas.

I did all the checks people have listed - all clear.

I've no idea what the cause was, but after about 6 weeks, everything cleared up and the pages reappeared fully indexed.

I don't find it particularly heartwarming to have a bleak spell like that, and the moreso because at the end of the URL only phase, my pages came back with me having made no changes to them.

The only common factor with the two sites is that they essentially had a splash page so that despite the homepage having a high PR and lots of links, the interior pages only really had one way in from the outside - via the one page that sat below the homepage.

I don't do that any more - I have more deep links to give me more ways in....
DerekH

12:02 pm on Feb 13, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



it is because Google is no longer functioning correctly

In my view this is absolutely right. Yes, some cases are due to problems with the site itself, but not all.

My view is that it is due to the way Google processes its updates. After Allegra about 10% of the pages of one of my sites lost their snippets and caches and became URL only - yet they still have toolbar PR. I have also noticed that some page caches have reverted to old versions.

Some of these pages were crawled just before the update. My guess is that the info somehow gets lost in the process. Perhaps cache and snippet info is kept on different databases to the urls? I wish someone could explain it to me!

I am sure there is nothing wrong with these pages and the solution will eventually correct itself as Google crawls the site, but its very frustrating. A site with a high PR may not even notice this problem if Google crawls daily.

1:54 pm on Feb 13, 2005 (gmt 0)

10+ Year Member



But my site has this problem for more than 6 months! and there is nothing wrong with it, it had indexed very well before this problem appears. The problem is most of my indexed pages (more than 7,000 indexed pages) have this problem!
2:02 pm on Feb 13, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Etarwin,

How many pages does Google crawl per week? If the site hasn't have high PR it could take an age for Google to get around to reindexing them all. You could look for a specific page in the logs to see when Google last crawled it.

2:19 pm on Feb 13, 2005 (gmt 0)

10+ Year Member



Etarwin, do you have any duplicate content on those pages?
2:24 pm on Feb 13, 2005 (gmt 0)

10+ Year Member



No
2:44 pm on Feb 13, 2005 (gmt 0)

WebmasterWorld Senior Member zeus is a WebmasterWorld Top Contributor of All Time 10+ Year Member



most of us has this problem that some of our pages are url only and with that we have also seen just to little search results, the rest are omitted for o reason, because they have complete different content.

No whats wrong here is Google can NOT handle all the new sites they inculded 3-4 month ago, so there indexing has become a problem.

Now we see different domains in site:mydomain.com search, To early omitted results, many Supplemental results, URL only pages, this realy looks like a spidering/server problem, they just cant handle all the sites anymore.

So if I was you I would not change anything

3:11 pm on Feb 13, 2005 (gmt 0)

10+ Year Member



I don't have the answer etwin but will share my experiences.

you say most of the pages are in the form page.php?id=1234

I had this problem a few years ago, this was a new site, google didn't take any of these pages. Specifically with 'id='. I used mod rewrite on these to make them appear static and then they were taken.

In december I lost a lot of pages to the symptoms you describe, they were dynamic pages again but not with 'id=' more 'cat=' and various other things. I have just changed them all to static url and used 301 redirects.

If you do this beware of the page rank going to 0 until it updates.

In the course of this I found that there was a problem with when I deleted categories/pages and google came to get them again. My site didn't give a 404 it pulled up stuff from other categories. (it used code I had written for another circumstance)

I have also done a 301 on [mysite.com...] to [mysite.com...]

I have moved host, the old server was heavily loaded.
I moved region so can watch google retake pages fresh.

I had a small html error on my pages, no closing tag for something, showed fine in the browser, don't know if it would matter.

I am no expert on files but there was a fairly long line in my generated html that I have shortened. (I was changing anything here)

I suspected duplicate content, but should point out this was paragraphs of 'product' description not entire exact pages.

Some people say do nothing, but I couldn't just leave it and hope so I made all the changes I had wanted to make anyway but hadn't when I was ranked ok.

My site is being residered and taken I think but PR on internal pages is all screwed at the moment.

Yahoo likes my new site and I am doing better than before, MSN is slightly worse at the moment and is still sending stuff to some of the old url, but roughly the same. Google is very slow spidering. MSN, Yahoo and Ask i'm pretty sure have been through the lot.

3:16 pm on Feb 13, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Do an allinurl:YourSite.com search and see if there are any redirects in the results. If so run that page through a header checker to see if it has a 302 redirect. If so it could be stealing your PR.
8:07 pm on Feb 13, 2005 (gmt 0)

10+ Year Member



>Do an allinurl:YourSite.com search and see if there are any redirects in the results.

Thank you Lorel but how can I know if there are any redirects in the results?

9:51 pm on Feb 14, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



ew, I just did the allinurl on my one site which had the problem. First I got two subpages from the site and the "If you like, you can repeat the search with the omitted results included." link.
When I clicked that, I got the about.htm page as the main page, with subpages indented below it, where one of them is the home page as: www.mysite.com with a complete description, then below those another UNindented link as: mysite.com with no description!
Typing in mysite.com in the address bar pulls up the site but does not seem to be resolving to www.mysite.com, like it used to. How do we change this? Could G suddenly have stopped combining indexes for the two as perhaps they did in the past?
12:43 pm on Feb 15, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



This may not be the answer to Etarwin's original problem, but as has been mentioned before, there is something odd with Google.

I checked a few of my pages which were url only after Allegra.

a) Pages crawled 12 Feb now have correct cache dated 12 Feb.

b) But pages crawled 10 or 11 Feb are still url only.

c) One page now has its snippet back in serps, but no cache.
However using Google toolbar brings up an obsolete cache dated 23 Feb 2004.

I suspect things will slowly get back to normal as Google crawls the site - and then it will go wrong again at the next update.

10:27 pm on Feb 16, 2005 (gmt 0)

10+ Year Member



Well,I guess when the dust clears all will be ok.
Doesn't look like much progress is being made
though
11:29 pm on Feb 17, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member




Do an allinurl:YourSite.com search and see if there are any redirects in the results.

Thank you Lorel but how can I know if there are any redirects in the results?

The URL will have their domain first and then yours on the end of the same url.

12:05 am on Feb 18, 2005 (gmt 0)

10+ Year Member



What is this?

Just done the allinurl thing on my site and was amazed to see a page showing that does not even have our url in it. I thought it was just another link to us.

The link to us from their domain is with this added:

/modules.php?name=Web_ Links&l_op=visit&lid=1151

Why does this show up in the allinurl search?

12:13 am on Feb 18, 2005 (gmt 0)

WebmasterWorld Senior Member zeus is a WebmasterWorld Top Contributor of All Time 10+ Year Member



GodLikeLotus - try a site:yourdomain.com is there also other domains if so wait some days I will bet your visits from google will go down, sorry to say this.
This 68 message thread spans 3 pages: 68