Forum Moderators: Robert Charlton & goodroi

Message Too Old, No Replies

Pages are disappearing from the index

unknown cause

         

specter

2:09 pm on Jul 19, 2007 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



hello,

My pages are disappearing from the google index.
Is there some updating I'm not aware?
I shouldn't be banned as I SEOed my site fairly, so I'm not able to comprehend what is happening.
I come from some .htaccess edits regarding the canonical domain and redirections: could it be the cause?
Alternately, why google bans a certain site?
does the ban affects also subdomains?

Does anyone came across such an issue?

Thanks to anyone who has useful news about.

Sincerely

SEOPTI

6:03 pm on Jul 19, 2007 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Check your supplementals first.

specter

6:04 pm on Jul 19, 2007 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



What do you mean?

...I would add that if I search with operator site: my indexed pages would be growing up.
But if I check the referrals from my stats they're disappearing...in fact my visits are decreasing significantly...
My subdomain instead works fine...

I am confused...

specter

10:07 pm on Jul 19, 2007 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



It seems there is no mention of my pages in the supplemental index.
Besides,G crawls them regularly on a daily basis...

Robert Charlton

10:22 pm on Jul 19, 2007 (gmt 0)

WebmasterWorld Administrator 10+ Year Member Top Contributors Of The Month



I come from some .htaccess edits regarding the canonical domain and redirections: could it be the cause?

Sounds like this might be a possible cause. You'll have to be more specific about what you did. I'd recommend going right to the Apache forum to get any detailed comments on your .htaccess. Be sure to use example.com if you post any code.

specter

10:30 pm on Jul 19, 2007 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Thanks Robert.

Really I already opened a thread at Apache forum to get advices about:

[webmasterworld.com...]

Anyway for your convenience here is what I done:

# Redirect all non-canonical domain requests to requested resource
# in canonical domain except for recognized subdomains
RewriteCond %{HTTP_HOST} .
RewriteCond %{HTTP_HOST}!^www\.example\.com
RewriteCond %{HTTP_HOST}!^sub\.example\.com
RewriteCond %{HTTP_HOST}!^www\.sub\.example\.com
RewriteCond %{HTTP_HOST}!^sub2\.example\.com
RewriteCond %{HTTP_HOST}!^sub3\.example\.com
RewriteRule (.*) http://www.example.com/$1 [R=301,L]

I could think that google is cleaning the index from the undesired domain (non-www) but from my google sitemap, I can see only www pages indexed, either searching for site:www.example.com and site:example.com, only different in number.

Moreover the weird is that some pages keep a high rank for their keywords, so that should mean that is not a ban or penalty or supplemental or similar issue...
or amI wrong?

tedster

9:39 pm on Jul 20, 2007 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



"Ban" means no pages from your domain are allowed in Google's index. So you're not banned.

Some penalties can be applied to certain keyword searches and not others, other are completely applied across the domain. Sometimes a drop in ranking is just that - Google has shifted the way the algo scores pages, so yours dropped.

There are so many factors that might play into your situation that it's hard to say anything specific. I'd suggest you give a good study to the threads listed in our Hot Topics [webmasterworld.com] section.

specter

10:11 pm on Jul 20, 2007 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Ok.I'll do it.
Thanks.

specter

7:09 pm on Jul 24, 2007 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Wow!...

...My pages are in the suplemental index...

I fairly optimized my site: I think it happened for the canonical domain issue.Probably it indexed both domains and penalized me for duplicate content...
could it be?

In order to clarify that issue,I would ask you something,at this point:

1) Searching for www. and non-www. pages I get only www. pages indexed, in both cases, only different in number.
Example:

site: http://www.example.com

returns

www.example.com/page1.html
www.example.com/page2.html
www.example.com/page3.html

site;http://example.com

returns

www.example.com/page1.html
www.example.com/page2.html
www.example.com/page3.html
www.example.com/page4.html
www.example.com/page5.html

Does this mean that only the correct domain is indexed?
Or non-www. pages are shown in the results anyway with the www. prefix (and so I should consider them as non-www. - hope to be clear -...)?

2) How to get out?
I would park a new domain on the existing one:could it be a good thing?
Should I change completely domain and web server?
What could be a good strategy?

Thanks for any help :)

g1smd

10:16 pm on Jul 24, 2007 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Try these searches instead:

site:www.domain.com
site:domain.com -inurl:www
site:domain.com

They will give a more clear picture as to what is happening.

specter

10:52 am on Jul 25, 2007 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Same results:

-inurl:www returns subdomain pages.

I noticed something:

I launch site: domain.com or www.domain.com it deosn't matter.
I get a regular list of indexed pages.
I have a page for "keyword":it appears regularly indexed.

I search for: "keyword mydomain.com":

My page for "keyword" appears in the supplemental index!...

What does this mean?