Welcome to WebmasterWorld Guest from 184.108.40.206
Forum Moderators: open
The pages haven't been totally removed, instead it seems that the pages exist in the Google SERPS but they have no title and no snippet and therefore no longer appear for any searches.
At first I thought this was some sort of penalty / filter to remove some of the controversial search sites from its index, but it seems this applies to other large sites, e.g. dmoz. I would estimate that dmoz has had around 200,000 pages "nuked".
Has anyone noticed this phenomenon on any other sites?
32-bit integer maximum = 4,294,967,296
Maybe you have to wait in line for a docID. This would not only explain what we're discussing here, but would also explain that strange "Supplemental Index," which has never had a shred of logic behind it.
In the event that someone types in something really bizarre to find a result, Google looks to the index in the hope that it will provide a relevant result - even if the result is dated.
This I what I understand it to be anyway.
pete, i am seeing that too. The pages I have missing only have one internal Inbound Link.
Could the new crawling system be set so that the page is only crawled on the second internal ibl (or the first external ibl). This would explain the sites that have huge deduction in googlebot hits.
Has anyone seen sites / pages that disproves this theory?
Did you mean if site is using adsense code that might be get the bann from G or Only url might be listed in the site search page.
One of my site is having around 30% pages listed as supplemental results in Google. What are the possibilities....?
Second one doesn't have any adsense no affiliate, no datafeed, But still 25% pages of the site are listed as url's only.
What could be the reason.
I am seeing directory pages being hit, admittedly with probable duplicate content....ie not many entries on these pages.
Also a suite of sites I know well who are espotting affiliates, but with lots of unique content have been hit, loosing 75% of their pages. There seems no pattern as to the pages that have been hit, some have pure espotting feeds and some not.
Is this the same issue being described and/or do I have a penalty?
However, some new pages had the problem. The strange thing about the new pages today is that they are my directory index files (examplesite.com/widget/). The pages within the category (/widget/red.html) are fine. And even stranger is that when I do a search for something specific that brings up a page in the category (like "red widgets") the category index page is second in the SERPS but it has the full listing - there is nothing wrong with it.
I did notice the other day that when my individual pages were having problems that the cache did not have the entire page saved (it stopped about halfway through the page).
We run a large network of UK sites, and all but 1 or 2 are showing this. Our traffic has crumbled because of it.
p.s. could GG maybe comment on this thread?
[edited by: fasteddie_uk2001 at 2:30 pm (utc) on Mar. 17, 2004]
One of my sites has all of its pages listed but about 50% of all pages with no title and description and no cache. The site also has no backlinks and white pagerank.
Both of these sites have good links and good PR before this PR update that occured today.
Has anyone that has been experiencing this issue lost their PR and links today as well?
Any input to help me understand whats going on is appreciated.
The only thing I am concerned about is that I was in conversation via Sticky with another member and he could not see the problem performing the exact same search.
With Google having so many datacentres there is a good chance of older data appearing for a while and you could just be hitting this datacentre.
This is happening to small sites too (Less than 500 pages)
Perhaps someone from Google will eventually comment. I just saw a pig flying past my window.
Sites with lots of content,
Sites with lots of backlinks,
Sites with few backlinks,
Sites with affiliate content,
Sites without affilaite content,
Sites with Adsense,
Sites without Adsense,
Sites with Duplicate content,
Sites with Unique Content,
etc etc etc
I can not see the link between the sites having the problem :(