| Welcome to WebmasterWorld Guest from 184.108.40.206 |
register, login, search, subscribe, help, library, PubCon, announcements, recent posts, open posts,
|allowing google bot only to index URL with parameters|
| 9:14 am on Oct 8, 2009 (gmt 0)|
I have made a mistake and google indexed 2 different URLs with same content
are both indexed and have the same content. I want to keep
and remove the other one from the google index. Since i have like 300 pages like this i dont want to do it manually. Is there any regular expression that i can put in to robots.txt to do it.
| 7:12 pm on Oct 8, 2009 (gmt 0)|
Very interesting situation. I cant think of a regular robots.txt expression. It may be easier to deal with this using a 301 redirect in htaccess.
All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
WebmasterWorld ® and PubCon ® are a Registered Trademarks of Pubcon Inc.
© Pubcon Inc. 1996-2012 all rights reserved