Forum Moderators: open
The pages haven't been totally removed, instead it seems that the pages exist in the Google SERPS but they have no title and no snippet and therefore no longer appear for any searches.
At first I thought this was some sort of penalty / filter to remove some of the controversial search sites from its index, but it seems this applies to other large sites, e.g. dmoz. I would estimate that dmoz has had around 200,000 pages "nuked".
Has anyone noticed this phenomenon on any other sites?
Are you suggesting it has been subject to a penalty of some sort?
No methods of creating hidden or false content are used at all. Just sensible titles, content & structuring are used.
32-bit integer maximum = 4,294,967,296
Maybe you have to wait in line for a docID. This would not only explain what we're discussing here, but would also explain that strange "Supplemental Index," which has never had a shred of logic behind it.
In the event that someone types in something really bizarre to find a result, Google looks to the index in the hope that it will provide a relevant result - even if the result is dated.
This I what I understand it to be anyway.
Yes, I guess that would explain the reason for the additional index.
pete, i am seeing that too. The pages I have missing only have one internal Inbound Link.
Could the new crawling system be set so that the page is only crawled on the second internal ibl (or the first external ibl). This would explain the sites that have huge deduction in googlebot hits.
Has anyone seen sites / pages that disproves this theory?
Did you mean if site is using adsense code that might be get the bann from G or Only url might be listed in the site search page.
One of my site is having around 30% pages listed as supplemental results in Google. What are the possibilities....?
Second one doesn't have any adsense no affiliate, no datafeed, But still 25% pages of the site are listed as url's only.
What could be the reason.
Exp...
I am seeing directory pages being hit, admittedly with probable duplicate content....ie not many entries on these pages.
Also a suite of sites I know well who are espotting affiliates, but with lots of unique content have been hit, loosing 75% of their pages. There seems no pattern as to the pages that have been hit, some have pure espotting feeds and some not.
Doug
It could be totally random - or are pages with only 1 link to them from 1 place now considered to be less important?....
Is this the same issue being described and/or do I have a penalty?
However, some new pages had the problem. The strange thing about the new pages today is that they are my directory index files (examplesite.com/widget/). The pages within the category (/widget/red.html) are fine. And even stranger is that when I do a search for something specific that brings up a page in the category (like "red widgets") the category index page is second in the SERPS but it has the full listing - there is nothing wrong with it.
I did notice the other day that when my individual pages were having problems that the cache did not have the entire page saved (it stopped about halfway through the page).
We run a large network of UK sites, and all but 1 or 2 are showing this. Our traffic has crumbled because of it.
f
p.s. could GG maybe comment on this thread?
[edited by: fasteddie_uk2001 at 2:30 pm (utc) on Mar. 17, 2004]
One of my sites has all of its pages listed but about 50% of all pages with no title and description and no cache. The site also has no backlinks and white pagerank.
My other site has only about 25% of pages listed and all have no title and description and no cache. The pages listed are all orphan pages that open in a new window via javascript. The site also has no backlinks and white pagerank.
Both of these sites have good links and good PR before this PR update that occured today.
Has anyone that has been experiencing this issue lost their PR and links today as well?
Any input to help me understand whats going on is appreciated.
f
I am not seeing pages return. :(.
f
The only thing I am concerned about is that I was in conversation via Sticky with another member and he could not see the problem performing the exact same search.
With Google having so many datacentres there is a good chance of older data appearing for a while and you could just be hitting this datacentre.
ThomasB
This is happening to small sites too (Less than 500 pages)
Perhaps someone from Google will eventually comment. I just saw a pig flying past my window.
Big Sites,
Small Sites,
Sites with lots of content,
Sites with lots of backlinks,
Sites with few backlinks,
Sites with affiliate content,
Sites without affilaite content,
Sites with Adsense,
Sites without Adsense,
Sites with Duplicate content,
Sites with Unique Content,
etc etc etc
I can not see the link between the sites having the problem :(
I have seen pages with PR (Even after the update) that are showing the no title/no description.
I will sticky you.
Dayo
One of my sites was showing PR but since this last PR update, it is no longer.
I wonder if what I am experiencing is something different than what is going on.
What do you think?
I agree, I would be more worried if my PR went from a PR5 to a PR0.
Check who you are linking to etc and just hope the next crawl will bring better results :)
Only thing is the problem may not be your doing!
Dayo
I am thinking it may be b/c of the orphaned javascript pages. I don't think these pages were ever indexed before.
Any thoughts?
Dayo, I think your point helps underline that shallow indexing is not just one thing.
