homepage Welcome to WebmasterWorld Guest from 54.211.212.174
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
Forum Library, Charter, Moderators: goodroi

Sitemaps, Meta Data, and robots.txt Forum

    
allowing google bot only to index URL with parameters
ulmudmezig




msg:4003605
 9:14 am on Oct 8, 2009 (gmt 0)

Hello,

I have made a mistake and google indexed 2 different URLs with same content

www.site.com/page.php?c=2&t=10
and
www.site.com/page.php?c=2

are both indexed and have the same content. I want to keep
www.site.com/page.php?c=2&t=10

and remove the other one from the google index. Since i have like 300 pages like this i dont want to do it manually. Is there any regular expression that i can put in to robots.txt to do it.

Thanks

 

goodroi




msg:4003925
 7:12 pm on Oct 8, 2009 (gmt 0)

Very interesting situation. I cant think of a regular robots.txt expression. It may be easier to deal with this using a 301 redirect in htaccess.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved