Forum Moderators: Robert Charlton & goodroi

Message Too Old, No Replies

Some URLs now dropped from a "perfectly listed site"

         

g1smd

8:08 pm on Oct 29, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



<The following message was cut from another thread [webmasterworld.com].>

Yes, one of my long-term "perfectly listed" sites, one that I use as a "reference" has suddenly had 30 of the 180 pages completely dropped from the index (a few weeks ago).

They aren't in the normal index, and they aren't supplemental either. They are not listed at all.

Have I hit an over optimisation penalty for having a unique title and unique meta data on every page, perfect code, perfect site navigation, and so on?

Or is it just some sort of new PR and IBL thing?

[edited by: tedster at 5:59 am (utc) on Nov. 1, 2006]

photopassjapan

11:35 pm on Oct 29, 2006 (gmt 0)

10+ Year Member



I think the same thing is happening to our site.
I mean the drop out because of no "significant" inbound links.
( And whatever people are saying, PR is still a good metric for this... if only for this alone, but it is. If it's zero, it's bye bye :) )

I guess having the index as thumbnails wasn't such a bright idea. Meaning a page with mostly images as links ( photo albums ). There are some text links like "first picture" and "last picture" which hold the framework together in the index, but the actual content is falling out from in between ;)

PR is passed on only for the first like... 2 images. ( ie. PR 2,1,0 ) Probably because G is following nothing but the text links, and PR is reduced by one point with each page...
And in the end... PR0 pages are starting to vanish.

Cool... i didn't know what comes next... at least i figured it out.
( Today, when it's already late. Probably. )

[edited by: tedster at 12:05 am (utc) on Oct. 30, 2006]
[edit reason] moved from another thread [/edit]

g1smd

12:22 am on Oct 30, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Additionally, there are a bunch of pages that moved to a new folder, and Google mostly lists the old URLs as Supplemental and mostly does not list the new URLs at all.

A new, additional, internal 301 redirect from the old to new URLs has at least kept the traffic flowing where that comes in on the "wrong" URL from search engine results.

tedster

12:27 am on Oct 30, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Is there a redirect in place from the old url to the new one?

g1smd

12:30 am on Oct 30, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



There is a redirect for the one moved folder. There are about a dozen "new" URLs that are not listed, and for those only their old counterpart still shows up (as Supplemental). About 8 of the new URLs "are" listed, one of them being listed as being at both the old and new locations (and old is Supplemntal of course). The folder was moved about 5 weeks ago. The Supplemental status appeared on the old URLs within a couple of weeks.

However, that is incidental to the main point. It is about 30 of the non-moving URLs that were completely dropped. They do not show up at all anywhere, in any type of search I do.

g1smd

12:43 am on Oct 30, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



The site has had both non-www to www and .co.uk to .com 301 redirects in place for much more than a year now. A few .co.uk URL showed as Supplemental for a long time after the redirects were put in place; but the site became "perfectly listed" a few months ago.

However, I am now wondering if perhaps there is an external link pointing to the old folder at either a non-www or a .co.uk URL, and therefore there is then an internal 301 redirect pointing to the old folder at www...com and this makes Google reluctant to drop the target URL even though that has been 404 for a few weeks.

The single-folder redirect wasn't put in place until at least 3 weeks after the folder was moved, so for a while there was a "hanging redirect", a 301 redirect that goes to a destination URL that generates a 404 error. Now there is a new 301 redirect from the old folder on non-www, and from the old folder on both www and non-www on any alternative domain, and with all directly pointing to the new folder at www...com (no chain).

Anyway, that is still incidental to the main point that 30 of the non-moving pages have vanished from the SERPs.

tedster

1:00 am on Oct 30, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



30 of the non-moving URLs that were completely dropped

Would those "newly moved" urls have had backlinks to the dropped non-moving pages? Here I'm thinking that taking away some backlinks from Google's calculations (temporarily, you can hope) might have dropped PR below some critical threshold. Still, odd that they would vanish completely rather than go Supplemental.

Have I hit an over optimisation penalty for having a unique title and unique meta data on every page, perfect code, perfect site navigation, and so on?

Maybe excessive 301's? I am working on a theory there. Only SEOs seem to know much about the 301 header. Most hosts and registrars are clueless, and so are most webmasters. So it seems to me that a lot of 301s might raise a question of attempts to manipulate things.

I work with plenty of sites that show all the other signs you mentioned above and they are thriving. But I treat 301 redirects like radioactive isotopes. They can help heal in some situations, but...

g1smd

1:12 am on Oct 30, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Due to the way that the drop-down CSS menu works, pretty much every page of the site links to every page of the site, though I warned the site owner long ago that as some of the links are in hidden and collapsed divs that Google might smell a spam attempt.

I need to check whether the site has an HTML sitemap page. I'm not sure if one was ever made and uploaded. If not, I'll recommend that be done soon.

I hear what you say about redirects. All www and non-www URLs on all alternative domains are redirected to www and to .com only, and then the one moved folder now has a redirect for all domains to the new folder location at the .com location. That new redirect is first in the .htaccess file.

Whitey

2:20 am on Oct 30, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



What tool are you using to measure and come to these conclusions?

I've got reservations about the site operator tool and also how it is being applied with "webmastery" . This is why i started this thread: [webmasterworld.com...]

[edited by: Whitey at 2:22 am (utc) on Oct. 30, 2006]

g1smd

9:27 pm on Oct 30, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



I am using site:domain.com and site:www.domain.com to see all that is listed.

I am using site:domain.com -inurl:www to show all types of Supplemental Results ("now 404", "now 301", and "historical").

trinorthlighting

10:39 pm on Oct 30, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Did they drop out of all data centers?

Whitey

11:34 pm on Oct 30, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



I am using site:domain.com and site:www.domain.com to see all that is listed.

But it's probably broken Site Tool Issues [webmasterworld.com] and/or it's probably telling us other things as well which haven't been explained by our good friends at Google or recognised by our community.

If we're making these assumptions i just make the point that it would be good to be able to rely on this tool that supports a lot of our assumptions and conversations.

It worries me that webmasters are provided tools to measure their site's performance on the one hand with little explanation, and on the other hand there is doubt as to whether it works or not.

I just make the point that webmasters greatly need some clarifications from G on this. IMO

[edited by: Whitey at 11:38 pm (utc) on Oct. 30, 2006]

texasville

11:48 pm on Oct 30, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Yep. That's the formula. Low or no pr...first they get dropped and then finally they will come back but will be supplemental. And they will stay there until they gain some significant ibl's.

trinorthlighting

11:49 pm on Oct 30, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



We like the site command via webmasters tools panel. Seem to be the most accurate there..

texasville

11:53 pm on Oct 30, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



>>>>>Maybe excessive 301's? I am working on a theory there. Only SEOs seem to know much about the 301 header. Most hosts and registrars are clueless, and so are most webmasters. So it seems to me that a lot of 301s might raise a question of attempts to manipulate things. <<<<<<<

It gets pretty bad when we have to worry that since some of us know the correct way of doing things...we need to beware of doing them as it might be misconstrued as manipulative. In other words...we need to dumb our sites down to stay under the radar. Wasn't there a book along these lines?...hmmmm

Marillion79

10:00 am on Oct 31, 2006 (gmt 0)

10+ Year Member



> Have I hit an over optimisation penalty for having a unique title and > unique meta data on every page, perfect code, perfect site navigation, > and so on?

> Or is it just some sort of new PR and IBL thing?

Did you seen any Java bots activities from Google IPs - Java/1.3.1_03,
Java/1.4.1_04 or Java/1.5.0_06?
Maybe your site in Web Purgatory for some reason.

g1smd

9:32 pm on Oct 31, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Unfortunately I don't have access to the logs for that site. I'm providing the advice on the SEO, but not actually doing any of the editing or coding.

I keep trying to get the site owner to download and save all the log files and then analyse trends over time, but that hasn't happened.

wanderingmind

4:38 am on Nov 1, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



The oly way to be sure a page is dropped is to check it in google by URL methinks.

I just saw a site losing almost 1000 pages in the site: count, but page impressions are very much stable, and going up as more get indexed for sure.

g1smd

2:43 pm on Nov 1, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



It has dropped on all datacentres, but the remaining page count is up or down by one or two on some of them.