Forum Moderators: Robert Charlton & goodroi

Message Too Old, No Replies

Pages dropping out of the index - in two months time it will be 0

Number of pages indexed drops from 112,000 to 270!

         

The_Tank

8:07 am on Apr 13, 2006 (gmt 0)

10+ Year Member



Has anyone else suffered from this? Has anyone else got their pages back? Did any one make changes to their site? If so what did you do?

I can't be the only one, I know some forum sites that have had similar experiences - but what about other sites?

Wally_Books

7:20 pm on Apr 19, 2006 (gmt 0)

10+ Year Member



I see a drastic improvement in Google today, after having most of our site go supplemental and slowing losing the few remaining pages, our page count went from 195 to 196. At this rate in another century or so we will be back.

Martin Galloway

7:36 pm on Apr 19, 2006 (gmt 0)

10+ Year Member



Excuse my somewhat rookie knowledge of SEO. Could someone please explain how I can find out if my sites have gone supplemental?

I have lost everything on all four sites, except my basic index page links on Google. For those sliding down that page count pole worrying what it's like at the bottom. Don't worry, I am already here, i'll break your fall!

Regards,

Martin.

Fighting Falcon

9:28 pm on Apr 19, 2006 (gmt 0)

10+ Year Member



Bad and getting worse. Its getting to a point where I've given up on google.

dhaliwal

10:09 pm on Apr 19, 2006 (gmt 0)

10+ Year Member



lost around 1 million pages on one site which was a wiki clone. also lost Pr on site

montefin

10:25 pm on Apr 19, 2006 (gmt 0)

10+ Year Member



hvacdirect:

"There is an interesting experiment going on over at the google-sitemaps group..."

Couldn't find this using search...is there anyway you can guide me there short of a url?

Jesse_Smith

12:44 am on Apr 20, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



"which was a wiki clone. also lost Pr on site"

That's called duplicate content.

BillyS

1:22 am on Apr 20, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I've stayed away from this thread because I'm not seeing the same thing as others as far as many pages being dropped.

I will say that after Matt asked us to submit problem sites (which I did - back in early March), over a five day period I saw my pages jump from around 200 to around 890 (the site has 1,100 pages).

Since that day my page count has been slowly decreasing and it's now around 800 - not nearly as bad as others are reporting. Mozilla Googlbot comes around frequently and I see it pick up new pages, however, nothing seems to be adding to the index, only slowly disappearing.

I don't think they've completely worked out the problem that GoogleGuy / Matt went after. Hopefully, they'll figure this out in the near term. Something is clearly not right.

Ironically, my traffic from Google continue to increase at a rate of around 15% per month. Go figure.

texasville

1:37 am on Apr 20, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



>>>>I don't think they've completely worked out the problem that GoogleGuy / Matt went after....

....Something is clearly not right. <<<<

BillyS,
you have a real knack for understatement.
LMAO.

eyezshine

3:42 am on Apr 20, 2006 (gmt 0)

10+ Year Member



It looks like the main googlebot came and indexed my entire site. Then the Mozilla 5.0 bot came through and deleted the pages it didn't like from the index. Is the 5.0 mozilla bot some kind of spam bot that simply deletes pages it don't like from the index and leave the ones it does like?

That would be an awesome idea! Instead of banning entire sites, simply ban the offending pages and leave the rest.

I really like this idea.

snowweb

4:20 am on Apr 20, 2006 (gmt 0)

10+ Year Member



I only have a very small site about 30 pages. It is in PHP using one template for all pages.

Each page has unique title and content. Content unique to the site. Every page validates perfectly at w3c.org yet over the past few days, I've seen my indexed pages slowly drop until I now only have my homepage left!

My pagerank also dropped at the end of March from 3 to 2 for no apparent reason. As far as I could see, I had made positive improvements to the site and introduced no negative ones.

Could it be that Google is penalizing me for using dynamic URLs like http://example.net/index.php?content=web_hosting_comparison

When my pagerank dropped after I converted the site to PHP, I thought I had overcome this by using the Google Sitemaps. It worked initially, in that Google then found all my pages and listed them, but since then they have slowly disappeared until just one left :-(

The site is still crawled but since I lost the last 9 yesterday, Googlebot doesn't seem to be visiting so much.

I even have adword & adsense accounts but they don't seem to effect the indexing!

I don't know how to contact google but I have to say, I'm losing faith in them now. I'm off to concentrate on optimizing for the other search engines.

Peter :-(

<No personal urls
See Forum Charter [webmasterworld.com]>

[edited by: tedster at 6:43 am (utc) on April 20, 2006]

kidder

4:28 am on Apr 20, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



We have several sites within one competitive area.
Google is telling us site 1 has over 26,000 pages - not bad considering the site only has about 3k in total.

Site 2 google is reporting over 10k but actually there is under 5k in total pages (older site and is ranking very well in searches)

Site 3 is new - ish. Google had it at about 60 steady pages then 900, then 11,000 only to drop us back to 44 mostly supplimental pages now... All in about the last 3 weeks. This happened after we moved a bunch of internal links to our index page to get some type action going.. This is a large site with several hundred thousand pages...

So it's all over the place.

arran

7:18 am on Apr 20, 2006 (gmt 0)

10+ Year Member



Has anyone successfully used google sitemaps to reverse/reduce this problem?

arran.

seosutra

7:37 am on Apr 20, 2006 (gmt 0)

10+ Year Member



hi everyone...

I do agree that search results on google are not as accurate as they used to be... pages with hardly any content are listed on top!

I think google is trying to device a way to fight spammers much effectively and sooner or later I feel they will go back to their results before BigDaddy but this time they will have a better spam detection rate....

I am keeping my fingures crossed!

------
seosutra

The_Tank

8:56 am on Apr 20, 2006 (gmt 0)

10+ Year Member



Has anyone successfully used google sitemaps to reverse/reduce this problem?
arran.

Nope.

eyezshine

9:59 am on Apr 20, 2006 (gmt 0)

10+ Year Member



I'm with Tank!

Nope.

tigger

11:43 am on Apr 20, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



G SMaps won't fix this! something is not right with G I'm seeing pages vanishing by the day and the few other webmasters that I chat to within my market all all seeing the same thing

It's really about time G put there hands up and said something is not working and a fix is being worked on!

JuniorOptimizer

12:00 pm on Apr 20, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Tigger, maybe nothing is being worked on.

tigger

12:13 pm on Apr 20, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



true, but I fail to see with the amount of webmasters that I know that are having good content pages dropped and reading postings here that "something" can't be right

After all how can a page that has ranked in the top for months with a PR4 now not been shown anywhere or even be cached!

Freedom

12:14 pm on Apr 20, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Has anyone successfully used google sitemaps to reverse/reduce this problem?

I'm using sitemaps and it's not helping at all.

I expect this situation to correct itself, but like other webmasters, I will lose a lot of business until that time comes. Google's constant volatility with unforgiving SNAFU's are becoming synonymous with the Google name itself. If one is not well positioned in MSN or Yahoo, then they are too much at the mercy of a tempermental of an over-rated search engine.

tigger

12:19 pm on Apr 20, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



>I expect this situation to correct itself

well lets hope like other glitches / roll backs it doesn't take another 6 months to resolve itself, because like most even though I rank on both Y & MSN its G that is UNFORTUNATELY the traffic builder

Wally_Books

12:52 pm on Apr 20, 2006 (gmt 0)

10+ Year Member



>Has anyone successfully used google sitemaps to reverse/reduce this problem?<

Sitemaps haven't helped, possibly the opposite. We just dropped them.

Martin Galloway

1:03 pm on Apr 20, 2006 (gmt 0)

10+ Year Member



Hi Tank:

I have not rated well on Yahoo, my sites are only 4 months old but got off to a good start with Google and MSNBot due to the large amount of reference information on the pages.

Since Easter I have disappeared almost completely now. I am a Google AdWords customer, the bots keep coming around but my pages are fizzling out.

Incidentally, I just checked my server logs at 7:00 am this morning. Does anyone know who Agent: Solnet-SwishSpider is? They have overtaken Googlebot in the amount of pages they have spidered. They went through about 500 this morning, Google only goes through about 30 or 40 per visit.

I bet the sales of Asprin have gone through the roof because of all this... sheesh.

Martin.

snowweb

1:51 pm on Apr 20, 2006 (gmt 0)

10+ Year Member



This seems to only have started being an issue for me after I converted our site to PHP and used dynamic links.

Now the only page listed is the one with no dynamic link - the homepage.

I'm about to convert my URLs to static (or what will appear to be static) URLs. Lets see if I get my pages back on to Google.

If you want to watch what happens, the site is <snip> (but I've not made the change yet. Going away tomorrow for the weekend, so I'll try to do it before I go).

I use sitemaps, so I will update the sitemap too and submit it to Google.

Peter

[edited by: trillianjedi at 2:08 pm (utc) on April 20, 2006]
[edit reason] Please see TOS, thanks. [/edit]

Dayo_UK

1:59 pm on Apr 20, 2006 (gmt 0)



Hi,

You cant post personal urls at WebmasterWorld - so if you would like to edit your post while you still can it would be cool (a mod will edit it sooner or later)

Oh BTW - check out posts on Canonical url issues etc. I would have thought that may be more likely than changing to php. (also check out some DCs and see if they have indexed the www and the non-www homepage (hint hint))

texasville

2:04 pm on Apr 20, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I really wish someone from google would explain this to me.
My images still are doing well in google. Getting hits. But the images are all on pages that google deindexed last week. If you go to the google search page that shows one of my images, and click on my image, it shows the deindexed page and say : Below is the image in its original context on the page mysite/green-widget.html.
However, if you go to google search and look for that exact url, you get:Your search - www.mysite/ green-widgets.html - did not match any documents.

So how can this be? On the one hand google says the page doesn't exist and on the other it says, here it is!

The absolute worst thing about this is I am climbing somewhat in the serps. site is coming out of sandbox and when people search, the return is for my index page. That means they are 2 clicks from the serp for the product. Instead of the product page returning for the search. Sheesh!

texasville

2:06 pm on Apr 20, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



BTW- Snowweb- save your time and trouble. Makes no difference if your pages are php or static. The site I have hit is all html.

tigger

2:09 pm on Apr 20, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



>So how can this be? On the one hand google says the page doesn't exist and on the other it says, here it is!

in theory the same as a page showing PR but no cached info - if I wasn't loosing money over this it would be almost funny

gford

2:48 pm on Apr 20, 2006 (gmt 0)

10+ Year Member



I'd be curious to know what industries people are being hit in.

I am being hit in sports, general directory, shopping and travel.

CygnusX1

2:51 pm on Apr 20, 2006 (gmt 0)

10+ Year Member



We too got hit and we are in the field of Hunting. Lost about 80% of our webpages that were 2 pages deep. All the main pages are still showing up.

I can only guess that google is going to come back and add these web-pages.

I hope anyway. :)

Martin Galloway

3:03 pm on Apr 20, 2006 (gmt 0)

10+ Year Member



gford: "I'd be curious to know what industries people are being hit in".
_____________________________

I am being hit in photos, sightseeing, lodging, UK editorial.

I have lost everything except my indexes on Google, and dropped from 172 Scotland pages to 9 on MSN.

I'm about to head for the Scotch cabinet.

Martin.

[edited by: tedster at 12:47 am (utc) on April 21, 2006]

This 168 message thread spans 6 pages: 168