homepage Welcome to WebmasterWorld Guest from
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Pubcon Platinum Sponsor 2014
Home / Forums Index / Google / Google SEO News and Discussion
Forum Library, Charter, Moderators: Robert Charlton & aakk9999 & brotherhood of lan & goodroi

Google SEO News and Discussion Forum

Recordset navigation and duplicate content

 8:25 pm on Jan 17, 2008 (gmt 0)

I'm worried that my recordset navigation may be causing duplicate content. My "Widget" site displays widgets 20 at a time so at the bottom of the page I have the 1񔘝 etc. page navigation. Once you navigate to another page the '1' link becomes offset=0 resulting in duplicate content.

have the same content

Should I be concerned about this?



 10:59 pm on Jan 17, 2008 (gmt 0)

Yes, that is a common Duplicate Content issue.

Each of those pages should have only one URL.


 11:03 pm on Jan 17, 2008 (gmt 0)

Yes, it's an issue. Either change your navigation to not include the Offset if it's 0, or add &offset=0 to all the other links on other pages linking to that page.


 11:05 pm on Jan 17, 2008 (gmt 0)

Go with the shortest URL as being the canonical version if you can.


 3:50 am on Jan 18, 2008 (gmt 0)

I just don't know how I could change the navigation to exclude &offset=0
so would this work in robots.txt?

Disallow: /*&offset=0$


 4:42 am on Jan 18, 2008 (gmt 0)

somewhere in the code there is a variable that tells you what page you are on, lets call it "page"
all you have to do is add some code like (not tested):

if page-1=0 then
Response.Write "<a href=""" & Request.ServerVariables("SCRIPT_NAME") & """>Previous Page</a>"
Response.Write "<a href=""" & Request.ServerVariables("SCRIPT_NAME") & "?offset=" & page - 1 & """>Previous Page</a>"
end if

This works with a page that has "Next" and "Previous" type pagination, but it should be simple to adapt it to 1 / 2 / 3 type


 9:33 pm on Jan 18, 2008 (gmt 0)

You can put that disallow statement in your robots.txt file, but the links would still exist on your site.

There are two negative effects from that:
1. They waste PageRank flow within your site; PageRank that could have been channeled elewhere.
2. They URLs are still visible to visitors who may well cut and paste those URLs in to the page content on other sites, thereby creating links to your site that are useless to you for PageRank.

Global Options:
 top home search open messages active posts  

Home / Forums Index / Google / Google SEO News and Discussion
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved