Forum Moderators: phranque

Message Too Old, No Replies

unindex indexed pages?

         

syktek

5:31 pm on Dec 22, 2005 (gmt 0)

10+ Year Member



if a page is already indexed and you no longer want it indexed if you use:
<meta name="robots" content="noindex,nofollow">
will it not only stop the page from being indexed but removed the url from the SE if already indexed?

basically i have a bunch of dynamically generated pages that have been indexed over the years that when they show up as a search result ultimately end up going to the same page with the same content. i'm not sure how bad that effects my rankings in the search engines but either way these urls are no longer valid and i want to avoid adding 10,000 entries into my robot.txt file.

tedster

11:00 pm on Dec 27, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



will it not only stop the page from being indexed but removed the url from the SE if already indexed

I tried this with a site last year,and the result was that previously indexed pages were eventually removed. No robots.txt or any other steps were taken -- just the robots meta tag.

Pfui

11:49 pm on Dec 27, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



If one of the SEs is G...

Every now and then I need to nudge Google into (re)heeding my robots.txt file(s) and request removal of specific directories and docs, particularly .txt files where "noindex,nofollow" kinds of tags don't apply.

I use their URL Remover [services.google.com], offering a number of Options you might find helpful, specifically: "Remove pages, subdirectories or images using a robots.txt file." (You'll need to create an account to access the features.)

Caveat: Be sure your Options instructions are correct because --

"Please keep in mind that submitting via the automatic URL removal system will cause a temporary, six months, removal of your site from the Google index..."

(I haven't found that to be a problem vis-a-vis my robots.txt-related 'updates' but YMMV.)

syktek

12:23 am on Dec 28, 2005 (gmt 0)

10+ Year Member



ok well my next question would be, how bad does it hurt my rankings if there are 2 different urls that have the same page content? say i created a sub-category and decided i wanted to later rename it but i also created a new sub-category with the new name but same content, now i have 2 different urls indexed though one is no longer in use, does that negatively hurt my rankings in y or g until those extra urls are unindexed?