Forum Moderators: Robert Charlton & goodroi
The pages of my website are linked from each page of the website and even my website has sitemap which has links to all the pages
But half of my pages appear normal in google index and half of them are into supplemental results
Why is this happening if they are linked from so many pages from my website
Can anyone help?
Thanks.
I think this is a google 'fog screen'. The reality is that if you are in the supplemental index you are never going to rank as well as a relevant page in the normal index. The reason for this is because (in my opinion) pages in the supplemental are deemed less likely to be useful and thus will only rank well if there is no alternative relevant page in the normal index.
My experience is that a page becomes supplemental because of duplicate content. Google will already have a page in the main index with a large proportion of the same content. I suspect pr has little to do with it. When they indexed the new page, the fact they already had the content will condem the page for ever more, even if you manage to get more pr than the existing main index page. The principle of 'first come first served' seems to apply. However, I have never tested this and maybe you can get a page into the main index to replace the existing one if you get a much higher pr. I would personally not bother to try, but instead add new pages to the site that have sufficiently 'unique' content. Change the template and make it smaller plus add new content for the new pages. As an aside, many 'news' stories, although duplicate content, will rank and appear on many sites for a search. Either Google treats 'news' in a different way or there is a period of time before the page is deemed duplicate and assigned to the supplemental index.
My advice is once you are in the supplemental index, forget trying to get out. Produce new pages that are better because google works on a page basis and not a site basis so new pages on a site can still rank well without being blighted by other pages on your site.
I know and I admit I'm not sure. However there are some very clever spammers out there who seem to get around it. What we see is not always what the spider sees. Please sticky me the urls, I would love to take a look.
Where the smokescreen is conserned, is this a reasonable assumption? What would be the point of telling people rubbish?
On my widgets site I set up a test server under the url of -
test.mysite.com
bare in mind that my actually site url is different ie - www.mysite2.com
Now google spidered that cos of a link off a forum or something so I then blocked all ip's expect my own from access it and password portected the directory.
It has been some time since that and google still has the reults as supp, thus causing a dup content filter, I believe.
How would I get rid of them from the supp results?
Exactly the sampe pages once as regular once as supplemental, strange.
Can anyone tell me specifically how to set-up a redirect to stop this from happening? I would like all of them to be indexed with the www.
I have searched and searched and not found the answer.
Anyways, the syndication has since been ended so in essence we've 'cleaned up' the site. We still rank OK for certain terms but a lot of our true content is now in the supplemental index.
Tried a reinclusion request just a few days ago.. do i have a hope in the world?
Thanks for the help.
here's a good thread re: your question [webmasterworld.com...]
however i have read around WW that you should be careful with the re-directs. i can't elaborate as i don't know the details/risks.. i just remember reading to be careful.
RewriteCond %{HTTP_HOST}!^www.yourdomain.com [NC]
RewriteCond %{HTTP_HOST}!^$
RewriteRule ^(.*) [yourdomain.com...] [R=301,L]
in your .htaccsess
but not for all here this will help, because you are filtered fo dublicated content - ex because of scrapers.
