Welcome to WebmasterWorld Guest from 54.211.5.239

Forum Moderators: goodroi

Message Too Old, No Replies

allowing google bot only to index URL with parameters

     
9:14 am on Oct 8, 2009 (gmt 0)

New User

5+ Year Member

joined:Sept 12, 2009
posts:1
votes: 0


Hello,

I have made a mistake and google indexed 2 different URLs with same content

www.site.com/page.php?c=2&t=10
and
www.site.com/page.php?c=2

are both indexed and have the same content. I want to keep
www.site.com/page.php?c=2&t=10

and remove the other one from the google index. Since i have like 300 pages like this i dont want to do it manually. Is there any regular expression that i can put in to robots.txt to do it.

Thanks

7:12 pm on Oct 8, 2009 (gmt 0)

Administrator from US 

WebmasterWorld Administrator goodroi is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:June 21, 2004
posts:3153
votes: 129


Very interesting situation. I cant think of a regular robots.txt expression. It may be easier to deal with this using a 301 redirect in htaccess.