A url only listing usually indicates that Gbot knows that the page exists and theoretically should at a future date index the page.
If the pages are not new I would suggest;
1. check your robots txt to see if gbot has been disallowed
2. check your meta tags for the same
3. make sure there no seesion cookies are being used as this can prevent gbo from indexing your site
I've noticed the following through experimentation:
I was tracking Google's indexing of a subsection of my site, and periodically some listings would "downgrade" to just a URL, losing the snippet and page title. After I removed the NOARCHIVE attribute from those pages, Google's indexing of them became more reliable and it no longer seemed to turn listings into URL-only listings.
That may be purely coincidental, of course...
Check your robots.txt AND if you do not have the robots.txt file, check if your 404 pages really return 404 code.
"Why most of my indexed pages in Google does not have any description?"
Evidently so, by your question and many others, it is because Google is no longer functioning correctly.
Google said no title in the URL could mean:
"getting dropped for particular keywords,"
I wonder what this means? Too high keyword density or spamming meta tags perhaps?
Does no one else have this problem?
I do. One of my sites has exactly the same problem as you descrbed. Fully indexed pages got nothing but a url. all snipets are gone. Google's referal dropped from 300/day to 30/day. Site traffic dropped in half. :(
>it is because Google is no longer functioning correctly.
Are you seroius?! It is not reasonable!
>1. check your robots txt to see if gbot has been disallowed
>2. check your meta tags for the same
>3. make sure there no seesion cookies are being used as this can prevent gbo from indexing your site
Every thing is fine, no one of the above cases appeared to me!
I noticed this case for most dynamic sites that have a url like the following format:
I just discovered this problem too. It's on a site for a non-profit organization which was doing fine for over a year, and all of a sudden the home page (with a PR5) has nothing showing but a URL. No site outtage, no robot.txt at all, nothing spiffy in the headers. Ironically many of the subpages are indexed just fine, although none of them seem to be coming up under searches for titles, content, etc. Seems like a penalty, but no idea why.
Google has always used my meta discription and H1 and H2 in the results. But since this last update the H tags have disappeared. Is this a sign that the h1 tags are not as important as they used to be?
I think Google created new plan by decreasing the storage size on their servers.
I remember I contacted them and they told me that google bot do not navigate in my site for some reasons.
I had exactly this with two of my sites before Christmas.
I did all the checks people have listed - all clear.
I've no idea what the cause was, but after about 6 weeks, everything cleared up and the pages reappeared fully indexed.
I don't find it particularly heartwarming to have a bleak spell like that, and the moreso because at the end of the URL only phase, my pages came back with me having made no changes to them.
The only common factor with the two sites is that they essentially had a splash page so that despite the homepage having a high PR and lots of links, the interior pages only really had one way in from the outside - via the one page that sat below the homepage.
I don't do that any more - I have more deep links to give me more ways in....
|it is because Google is no longer functioning correctly |
In my view this is absolutely right. Yes, some cases are due to problems with the site itself, but not all.
My view is that it is due to the way Google processes its updates. After Allegra about 10% of the pages of one of my sites lost their snippets and caches and became URL only - yet they still have toolbar PR. I have also noticed that some page caches have reverted to old versions.
Some of these pages were crawled just before the update. My guess is that the info somehow gets lost in the process. Perhaps cache and snippet info is kept on different databases to the urls? I wish someone could explain it to me!
I am sure there is nothing wrong with these pages and the solution will eventually correct itself as Google crawls the site, but its very frustrating. A site with a high PR may not even notice this problem if Google crawls daily.
But my site has this problem for more than 6 months! and there is nothing wrong with it, it had indexed very well before this problem appears. The problem is most of my indexed pages (more than 7,000 indexed pages) have this problem!
How many pages does Google crawl per week? If the site hasn't have high PR it could take an age for Google to get around to reindexing them all. You could look for a specific page in the logs to see when Google last crawled it.
Etarwin, do you have any duplicate content on those pages?
most of us has this problem that some of our pages are url only and with that we have also seen just to little search results, the rest are omitted for o reason, because they have complete different content.
No whats wrong here is Google can NOT handle all the new sites they inculded 3-4 month ago, so there indexing has become a problem.
Now we see different domains in site:mydomain.com search, To early omitted results, many Supplemental results, URL only pages, this realy looks like a spidering/server problem, they just cant handle all the sites anymore.
So if I was you I would not change anything
I don't have the answer etwin but will share my experiences.
you say most of the pages are in the form page.php?id=1234
I had this problem a few years ago, this was a new site, google didn't take any of these pages. Specifically with 'id='. I used mod rewrite on these to make them appear static and then they were taken.
In december I lost a lot of pages to the symptoms you describe, they were dynamic pages again but not with 'id=' more 'cat=' and various other things. I have just changed them all to static url and used 301 redirects.
If you do this beware of the page rank going to 0 until it updates.
In the course of this I found that there was a problem with when I deleted categories/pages and google came to get them again. My site didn't give a 404 it pulled up stuff from other categories. (it used code I had written for another circumstance)
I have also done a 301 on [mysite.com...] to [mysite.com...]
I have moved host, the old server was heavily loaded.
I moved region so can watch google retake pages fresh.
I had a small html error on my pages, no closing tag for something, showed fine in the browser, don't know if it would matter.
I am no expert on files but there was a fairly long line in my generated html that I have shortened. (I was changing anything here)
I suspected duplicate content, but should point out this was paragraphs of 'product' description not entire exact pages.
Some people say do nothing, but I couldn't just leave it and hope so I made all the changes I had wanted to make anyway but hadn't when I was ranked ok.
My site is being residered and taken I think but PR on internal pages is all screwed at the moment.
Yahoo likes my new site and I am doing better than before, MSN is slightly worse at the moment and is still sending stuff to some of the old url, but roughly the same. Google is very slow spidering. MSN, Yahoo and Ask i'm pretty sure have been through the lot.
Do an allinurl:YourSite.com search and see if there are any redirects in the results. If so run that page through a header checker to see if it has a 302 redirect. If so it could be stealing your PR.
>Do an allinurl:YourSite.com search and see if there are any redirects in the results.
Thank you Lorel but how can I know if there are any redirects in the results?
ew, I just did the allinurl on my one site which had the problem. First I got two subpages from the site and the "If you like, you can repeat the search with the omitted results included." link.
When I clicked that, I got the about.htm page as the main page, with subpages indented below it, where one of them is the home page as: www.mysite.com with a complete description, then below those another UNindented link as: mysite.com with no description!
Typing in mysite.com in the address bar pulls up the site but does not seem to be resolving to www.mysite.com, like it used to. How do we change this? Could G suddenly have stopped combining indexes for the two as perhaps they did in the past?
This may not be the answer to Etarwin's original problem, but as has been mentioned before, there is something odd with Google.
I checked a few of my pages which were url only after Allegra.
a) Pages crawled 12 Feb now have correct cache dated 12 Feb.
b) But pages crawled 10 or 11 Feb are still url only.
c) One page now has its snippet back in serps, but no cache.
However using Google toolbar brings up an obsolete cache dated 23 Feb 2004.
I suspect things will slowly get back to normal as Google crawls the site - and then it will go wrong again at the next update.
Well,I guess when the dust clears all will be ok.
Doesn't look like much progress is being made
Do an allinurl:YourSite.com search and see if there are any redirects in the results.
Thank you Lorel but how can I know if there are any redirects in the results?
The URL will have their domain first and then yours on the end of the same url.
What is this?
Just done the allinurl thing on my site and was amazed to see a page showing that does not even have our url in it. I thought it was just another link to us.
The link to us from their domain is with this added:
Why does this show up in the allinurl search?
GodLikeLotus - try a site:yourdomain.com is there also other domains if so wait some days I will bet your visits from google will go down, sorry to say this.
| This 68 message thread spans 3 pages: 68 (  2 3 ) > > |