Forum Moderators: Robert Charlton & goodroi

Message Too Old, No Replies

Pages dropping out of the index - in two months time it will be 0

Number of pages indexed drops from 112,000 to 270!

         

The_Tank

8:07 am on Apr 13, 2006 (gmt 0)

10+ Year Member



Has anyone else suffered from this? Has anyone else got their pages back? Did any one make changes to their site? If so what did you do?

I can't be the only one, I know some forum sites that have had similar experiences - but what about other sites?

Madcat carver

3:07 pm on Apr 20, 2006 (gmt 0)

10+ Year Member



I have the same problem. I have a dynamic template site. I’ve been trying to get my paged indexed in the past month and a half via links to my internal pages. Google indexed about 120 pages of my 300 page site and I was ecstatic! A week after the pages were indexed they were dumped and now I have 19 – 22 pages indexed depending on which Google Server you check.
Could it be the pages that have had either new inbound links added from the web or their content changed recently?

Here’s the email I sent Google and the response I got:

[Email excerpts of ANY type or length are not allowed on
WebmasterWorld. There are no exceptions to this rule.
Terms of Service #9 [webmasterworld.com]]

[edited by: tedster at 12:50 am (utc) on April 21, 2006]

tigger

3:07 pm on Apr 20, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



>gford: "I'd be curious to know what industries people are being hit in".

ummmm toys <wink/> & dating - but I've had clients site also effected by this

The_Tank

3:13 pm on Apr 20, 2006 (gmt 0)

10+ Year Member



>gford: "I'd be curious to know what industries people are being hit in".

Hardware and software

tigger

3:16 pm on Apr 20, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I don't see this as industry specific as everyone I've spoken to over the last few days has been in different markets -

gford

3:17 pm on Apr 20, 2006 (gmt 0)

10+ Year Member



Sounds like there is a broad range of types of sites. Hrm, so much for a certain type of site or industry. Doubt we all use the same templates :-p

frakilk

3:23 pm on Apr 20, 2006 (gmt 0)

10+ Year Member



It's definitely not industry specific. Results are puree everywhere. I used Ask for a unanswered Google query the last day and had a big grin on my face afterwards.

Martin Galloway

3:27 pm on Apr 20, 2006 (gmt 0)

10+ Year Member



gford "Doubt we all use the same templates..."

Mine are custom made in Dreamweaver, totally unique and not the cookie cutter commercial plug and play type.

You work hard for several years, up late at night, falling asleep at the computer, to create a great site with unique content. The bots come along and you are as excited as a new Father...

.. then they take it all away in one single weekend.

It's like having your house stolen, removed off the foundations with no explanation... except for the toilet... because that's where all our hard work has just gone.

This is a wake-up call guys.. we have to be more independent. We are being treated like little puppets on strings, one snip and we are dead.

Martin.

iProgram

3:43 pm on Apr 20, 2006 (gmt 0)

10+ Year Member



G SMaps won't fix this! something is not right with G I'm seeing pages vanishing by the day and the few other webmasters that I chat to within my market all all seeing the same thing

I agree with you and there is something not right with G index. I saw a lot of strange problems since last weekend. For example, a 300,000 results keyword has only two pages of serp in some datacenter; a same web page (completely same, one URL) listed twice on page1 and page2 (they fixed this). A sandboxed website of mine was shown as "Domain.Tld" instead of "title of domain.tld" when searching "site:www.domain.tld" on 64.233.187.104 dc.
One of my personal fan site uses Google API as in-house search engine and I found the serp of my website comes back to early of Jan.

It's really about time G put there hands up and said something is not working and a fix is being worked on!

They are busy working on... see the top-right corner of this page <g>.

texasville

9:51 pm on Apr 20, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



>>>>gford: "I'd be curious to know what industries people are being hit in". <<<

Farm and automotive and equipment kinda.

yandos

10:24 pm on Apr 20, 2006 (gmt 0)

10+ Year Member



Same stuff happening to some of my sites, ones gone from 1.2 million to 364 pages indexed. The strange thing is that a recently launched site of mine has gone from nothing to 49K indexed pages in around 2 weeks after pointing a few high PR links to it, so it seems to be affecting older rather than brand new sites.

It used to be the case that you worked hard at ranking your sites, not its a battle just to keep them in the index!

Martin Galloway

10:35 pm on Apr 20, 2006 (gmt 0)

10+ Year Member



yandos:

Same stuff happening to some of my sites, ones gone from 1.2 million to 364 pages indexed
______________________________________________

Could someone please explain to me in plain English how it is humanly possible to have 1.2 million pages on Google?

Surely there is some serious automation going on that Google has figured out.

yandos, could you please send me the URL privately. My comprehension of how one produces over 1 million pages is obviously needing some serious education.

Thankyou.

Martin.

cgchris99

10:49 pm on Apr 20, 2006 (gmt 0)

10+ Year Member



One of my sites has started to recover. The other is still in supplemental h$ll.

The one that is recovering is gaining many indexed pages per day. Yipee. Let just hope it sticks.

Hopefully this means other sights will start to recover soon, including my other site.

Atomic

11:02 pm on Apr 20, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



My comprehension of how one produces over 1 million pages is obviously needing some serious education.

It's quite possible. Think 10 year old forums, joke sites, recipe sites, blogs or anything old with user created content. There are a lot of sites that that fit that description and they are perfectly legitimate.

moTi

12:16 am on Apr 21, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



i'm down from 300,000 to fluctuating 60,000-80,000 the recent weeks.
site is template driven, static urls.

all 3rd level pages have disappeared.

maybe it's a duplicate content filter gone mad? i call that a pretty silly fight against duplicate spam, if that is what google is trying to achieve.
what we see now is homepages appearing instead of exact deep linked matches, forcing the user to click through to the wanted information. and honest publishers being hit instead of spammers. i would imagine that if people really want to inflate the index with their pages, they already have changed (automatically) a few words to say 85% quote of duplication or shuffled the whole nonsense or generated another template to make the page look different to the bot in order to show their copied content, right?

what a mess. i liked the previous practice of filtering per relevancy and pulling irrelevant results to the end of the serps (for all i care they could kick them out completely as well).

however, one sentence in googles' answer to a previous poster cought my attention:

In general, webmasters can improve the rank of their sites by increasing
the number of high-quality sites that link to their pages.

so you have to get valuable inbound links to your deep pages, a sitemap or deep-link from your own website does not suffice? this would be crazy.
have google given up their relevancy criteria instead of automatically cutting out valuable deep content? like "enough already, we've seen it all.."

let's hope that it's only an unsuccessful test.

Stefan

12:42 am on Apr 21, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



It's quite possible. Think 10 year old forums, joke sites, recipe sites, blogs or anything old with user created content. There are a lot of sites that that fit that description and they are perfectly legitimate.

I've noticed that many of the posts about pages gone missing are from people who have massive sites (not all). I can't help but think that G is finally clearing out some of the dross. To be honest - if you have a million pages, and you're not Wikipedia, most of it was generated to increase SE traffic. We all know this here. So does Google.

kidder

12:51 am on Apr 21, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



The people are still out there clicking so someone must be getting the traffic - We have our older sites either static or dropping and another new site that we have been doing some serious link exchanges with and I mean 4 guys full time doing traffic trades (nothing to do with Google) Just banner swaps. It's gone from PR 0 to PR4 and G seems to happily be adding pages and sending in the traffic.

hu12

1:00 am on Apr 21, 2006 (gmt 0)

10+ Year Member



:(

>>>>gford: "I'd be curious to know what industries people are being hit in". <<<

economics, financial

Joy6320

1:42 am on Apr 21, 2006 (gmt 0)

10+ Year Member



This is my 1st post. I am a financial advisor to governments with only about 35 pages. The indexed total is now down to 13. All of the pages that have been dropped are scholarly articles relating to different financing matters of interest to governments. The pages were dropped a little more than 30 days ago and I had no problem prior to that time. All 35 pages are indexed just fine on Yahoo and MSN.

Atomic

2:04 am on Apr 21, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



I've noticed that many of the posts about pages gone missing are from people who have massive sites (not all). I can't help but think that G is finally clearing out some of the dross. To be honest - if you have a million pages, and you're not Wikipedia, most of it was generated to increase SE traffic. We all know this here. So does Google.

That's all very interesting but my largest site's content is almost all user generated. It's held up pretty well. Lost maybe a few hundred thousand pages but I am confident they'll come back. We have some excellent sites that link to us like NASA because they consider some of the pages to be so useful what with all the scientists that post their and share info with each other. I find great information in searching forums all the time. There are all kinds of useful gems to be found whether you want to get rid of spyware, get a recommendation on a restaurant or find relationsip advice. What you say about this being generated to increase SE traffic is a load. The site I mention has not a single ad on it and is supported by donation only. Can't imagine why we'd want useless fluff on an educational tool. Maybe I'm too dumb to figure it out but give me time and I'll be right there with you.

[edited by: Atomic at 2:08 am (utc) on April 21, 2006]

BillyS

2:04 am on Apr 21, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Welcome to WebmasterWorld Joy6320!

I'm going to make it three in a row, Financial.

harpoon

2:13 am on Apr 21, 2006 (gmt 0)

10+ Year Member



I started a site a couple a months ago. When I checked a month ago, the index had 150 pages. Now its down to 25.

Madcat carver

2:16 am on Apr 21, 2006 (gmt 0)

10+ Year Member



No finances here… Themepark props.

Martin Galloway

2:17 am on Apr 21, 2006 (gmt 0)

10+ Year Member



Atomic says:-
"We have some excellent sites that link to us like NASA" .... "Maybe I'm too dumb to figure it out but give me time and I'll be right there with you."
_______________________

Har de, you are funny!

I'd say with several hundred thousand pages and having a backlink from NASA... that you are doing pretty good and certainly no dummy.

Since we can't benefit from URL's in here, could you please send me the URL to your site privately?

Thanks, there really is life beyond Pluto.

Martin.

ClintFC

2:34 am on Apr 21, 2006 (gmt 0)

10+ Year Member



I've noticed that many of the posts about pages gone missing are from people who have massive sites (not all). I can't help but think that G is finally clearing out some of the dross. To be honest - if you have a million pages, and you're not Wikipedia, most of it was generated to increase SE traffic. We all know this here. So does Google.

You've hit the nail on the head here. Please don't take this the wrong way, but it is precisely dumb talk like that that does appear to be winning the day at Google nowadays.

The notion that you can reliably generalise about the "quality" of a website by a simple count of its pages, or by its rate of growth, or by its linking structure, or by its subject matter, or by its age...is just plain ridiculous. Of course there is SPAM out there, but the term is far too liberally applied. All too often people use the term to describe any website that is unlike their own.

Ironically, by many of it's own metrics Google is the biggest Spam-site out there. 99.9999999% of Google is just scraped duplicate content is it not?

eyezshine

3:25 am on Apr 21, 2006 (gmt 0)

10+ Year Member



Today I noticed a small increase in traffic so I checked Google and sure enough, my pages indexed went up a little today. From 165 to 189 pages for a site command. I checked my stats and google is definately sending more traffic today compared to yesterday.

This is wierd?

dramstore

7:32 am on Apr 21, 2006 (gmt 0)

10+ Year Member



"be honest - if you have a million pages, and you're not Wikipedia, most of it was generated to increase SE traffic"

site:www.webmasterworld.com

tigger

7:36 am on Apr 21, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



a million pages for a website is a lot but I suppose it is possible, I started a site 18 months ago that I thought would be 50-100 pages at the top and I'm still adding content now and the site stands at 800 - although since G has been dropping pages according to them I only have 168

The_Tank

8:29 am on Apr 21, 2006 (gmt 0)

10+ Year Member



Well as of 09:25 GMT I am down to 179 pages indexed from my original 112,000.

I have found some kind of pattern and that is every day around 5% of the site is being removed. (Still do not have a clue why!)

tigger

8:32 am on Apr 21, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Jesus thats some drop and I thought I was bad! your traffic levels must have really fallen off, I'm 30% down!

lasko

8:59 am on Apr 21, 2006 (gmt 0)

10+ Year Member



I'll have to chip into this topic as well.

Some of our client web sites have content disappearing, titles mixed up with other sites sharing the same server.

I've just applied a dedicated IP address to some of the sites to help fix the shared titles.

This happened 2 weeks ago when the PR was being updated. Today the titles are still wrong but its too early for them to update it.

Issues we can see so far are:

Wrong Titles some reporting missing titles altogether
Pages disappearing
Incorrect PR values probably based on missing content/pages
Huge flux in SERP's

What to do?

Nothing, just like florida and others, take a drink, enjoy spring, decorate the house, write a will, try something new and leave google to dance.

This 168 message thread spans 6 pages: 168