Welcome to WebmasterWorld Guest from 54.166.117.130

Recordset navigation and duplicate content

   
8:25 pm on Jan 17, 2008 (gmt 0)

10+ Year Member



I'm worried that my recordset navigation may be causing duplicate content. My "Widget" site displays widgets 20 at a time so at the bottom of the page I have the 1񔘝 etc. page navigation. Once you navigate to another page the '1' link becomes offset=0 resulting in duplicate content.

http://www.example.com/widget.asp?color=green&offset=0
AND
http://www.example.com/widget.asp?color=green
have the same content

Should I be concerned about this?

10:59 pm on Jan 17, 2008 (gmt 0)

WebmasterWorld Senior Member g1smd is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month



Yes, that is a common Duplicate Content issue.

Each of those pages should have only one URL.

11:03 pm on Jan 17, 2008 (gmt 0)

WebmasterWorld Administrator lifeinasia is a WebmasterWorld Top Contributor of All Time 5+ Year Member Top Contributors Of The Month



Yes, it's an issue. Either change your navigation to not include the Offset if it's 0, or add &offset=0 to all the other links on other pages linking to that page.
11:05 pm on Jan 17, 2008 (gmt 0)

WebmasterWorld Senior Member g1smd is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month



Go with the shortest URL as being the canonical version if you can.
3:50 am on Jan 18, 2008 (gmt 0)

10+ Year Member



I just don't know how I could change the navigation to exclude &offset=0
so would this work in robots.txt?

Disallow: /*&offset=0$

4:42 am on Jan 18, 2008 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



somewhere in the code there is a variable that tells you what page you are on, lets call it "page"
all you have to do is add some code like (not tested):

if page-1=0 then
Response.Write "<a href=""" & Request.ServerVariables("SCRIPT_NAME") & """>Previous Page</a>"
else
Response.Write "<a href=""" & Request.ServerVariables("SCRIPT_NAME") & "?offset=" & page - 1 & """>Previous Page</a>"
end if

This works with a page that has "Next" and "Previous" type pagination, but it should be simple to adapt it to 1 / 2 / 3 type

9:33 pm on Jan 18, 2008 (gmt 0)

WebmasterWorld Senior Member g1smd is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month



You can put that disallow statement in your robots.txt file, but the links would still exist on your site.

There are two negative effects from that:
1. They waste PageRank flow within your site; PageRank that could have been channeled elewhere.
2. They URLs are still visible to visitors who may well cut and paste those URLs in to the page content on other sites, thereby creating links to your site that are useless to you for PageRank.

 

Featured Threads

My Threads

Hot Threads This Week

Hot Threads This Month