Page is a not externally linkable
- Google
-- Google SEO News and Discussion
---- Googlebot ignoring robots.txt AND WMT parameter settings


ichthyous - 2:06 pm on Aug 9, 2012 (gmt 0)


Lately the number of duplicate page titles and decriptions Google is reporting for my site in Webmaster Tools has been increasing. The great majority of those reported pages are just the same page with navigational parameters added to the end. For example: site.com/pageurl/ and site.com/pageurl/?g2_navId=xfe40ba4a are being considered dupes now when they weren't before. I have blocked google from indexing the dynamic urls in robots.txt for years and I have set the parameter under "URL Parameters" in Webmaster Tools to "one representative url" as they recommend...also did this a few years ago. Still, google is now indexing these pages when it wasn't before and considering them duplicates of the page without the dynamic string appended. Other than adding some rewrite rule to my .htaccess file to redirect GB to merge all the pages is there any way to control this? I believe that the dynamically appended urls are necessary for navigation so I might be limited in using rewrite rules. I was also wondering if all these dupe page titles and descriptions may bring down my quality score and hurt my ranking? Thanks for any advice!


Thread source:: http://www.webmasterworld.com/google/4483195.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com