Welcome to WebmasterWorld Guest from 188.8.131.52
A lot of members are seeing huge sites going supplemental. One of our main sites lots all rankings and 200,000 + pages disappeared and now we are left with 19k useless results. This could be a goof or it could be a new round of penalties. If you have had your site reduced to the 'sup index lets here about it and compare notes.
Another piece of info the cache date on the the rest of the datacenter with the supplemental problem the cache shows jun 05 - aug 05, prior to the problem they showed feb 2006. Big Daddy in now showing Feb 2006 cache no supplementals in the first 1000. The rest of the datacenters are still showing supplementals after the homepage
Last May I got hit by Canonical problems. I took all the recommended remedial action and in the past few weeks Google was finally indexing the site normally, though rankings were still shot to s***.
So I have nothing to lose, because I lost it all back in May anyway...
huge sites having few thousand pages have now dropped to 100s of supplemental pages
definetely some major update with bigdaddy DCs, NO penalty for sure just a complete reshuffle and reindex.
1. Many of my indexed pages are now showing as URL only, and I am not sure exactly what this means.
2. On one of the DC's it was showing an indexed page that is forbidden by the robots.txt, namely in the cgi-bin directory. We have had the cgi-bin directory excluded by the robots.txt from day one, so I am perplexed as to why this page is showing when I do a site:mydomain.com search.
There is a 300+ page diff between the 2 DC's one appears correct while the other is missing the 300+ pages.
Guess all one can do is wait until the dust settles and see what happens then.
Does anyone have an example of a totally clean non-commercial site that has been hit? Like the Red Cross, Wikipedia or something?
I have dropped to less than 10% of my pre-BigDaddy referral traffic from Google in the past couple weeks. I have a site with ALL original content.
I am actively using the Google Sitemaps tool.
I have multiple domains that point to my site, but they all get 301'ed to my main URL. Mostly they are URLs of old sites I had that still got some traffic that I wanted to direct to my main site.
2,470 from Googlebot
3,010 from Mozilla Googlebot
My site shows roughly 1,080 pages in Non-BD centers and 345 in BD - of which many are supplemental. What I find interesting is the apparent size of BD (22 billion indexed) yet there are many here stating they are losing pages.
Of course I am losing traffic (not ranking) because many of my pages are missing. However, for pages that are still in the index, I continue to move up the SERPS. As was mentioned elsewhere, this could be because my competition is also losing pages. On the other hand, I am also climbing the SERPs on non-BD centers.
I do have faith that we are on the brink of some kind of purge and reload - nothing more. That's because I have faith in the Google engineers. Also for me, this has been a slow and steady process - nothing like a run away train. Keep the faith.
there's no way to select or change the index in which a site appears
I redesigned a website a couple months ago which had over 1/2 the pages in the supplemental result index. The previous web designer had copied text from other sites so I rewrote all the affected pages. Shortly after the redesign the supplementals disappeared. And they are still gone.
In this case I think its an error too because of the scale, but no: I had a site go supplemental long before this and it was every page. I dunno what the process or threshhold is, but Google WILL suddenly wipe out an entire site this way.
MB, With Big Daddy being propagated to nearly half of the datacenters, I tend to believe that those affected sites with supplementals share the same experience as mine - with drastic drop in traffic.