Welcome to WebmasterWorld Guest from 54.160.254.203

Message Too Old, No Replies

Decrease in indexed URLs from Sitemap

     
10:07 pm on Jun 20, 2012 (gmt 0)

Junior Member

joined:Apr 25, 2012
posts: 53
votes: 0


Yesterday I noticed that my alexa rank fell about 18% so I checked a few longtail keywords (which I know I rank on page 1 for) and noticed that I'm not showing in serps for them anymore. I then had a look in WMT and noticed that indexed URLs from my sitemap dropped from over 700 down to 546 (with 1248 submitted).

I then checked duplicate meta descriptions and found a description with over 602 duplicates. These duplicates were a particular category with all the different parameters. ie category-name/?cat=138&dir=asc&limit=10&order=position&p=1&price=1%2C100.

What effect & crawl setting should I be using for the "cat" parameter and could these duplicates have caused my sudden drop?
12:41 am on June 21, 2012 (gmt 0)

Administrator

WebmasterWorld Administrator phranque is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Aug 10, 2004
posts:10544
votes: 8


you might want to read through this thread which discusses the challenges of "faceted navigation":
http://www.webmasterworld.com/google/4097582.htm [webmasterworld.com]

and Faceted Navigation Problems and Noindex:
http://www.webmasterworld.com/google/4263118.htm [webmasterworld.com]
1:10 am on June 21, 2012 (gmt 0)

Junior Member

joined:Apr 25, 2012
posts: 53
votes: 0


I've had a read through them both but still unsure how to handle certain parameters. For example, the following all go to the same category page. Should I setup the ?cat= parameter as a Representative URL or just stop any ?cat= content from being indexed?

essentials?cat=133
essentials?cat=134
essentials?cat=135
7:14 am on June 21, 2012 (gmt 0)

Administrator

WebmasterWorld Administrator phranque is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Aug 10, 2004
posts:10544
votes: 8


first you should determine what the canonical url should be for your content.

then prevent any non-canonical urls from being indexed.
how you do that depends on a lot of things, but your choices include 301 redirecting non-canonical requests to the canonical url, noindexing non-canonical urls, using the link rel canonical element, or ignoring non-canonical parameters by specifying these in a webmaster console.

so if http://example.com/essentials?cat=133 is the same as http://example.com/essentials?cat=134 is it also the same as http://example.com/essentials - i.e. is the entire query string non-canonical?
10:43 am on June 21, 2012 (gmt 0)

Junior Member

joined:Apr 25, 2012
posts: 53
votes: 0


For some reason I had 2 link rel="canonical" on each page. One had a trailing slash and the other didn't. Not sure how long it's been like that but I'm sure it's from a dodgy extension.

Question.. Do you think its a problem if canonical url's have a trailing slash but the urls in the sitemap don't?
11:15 am on June 21, 2012 (gmt 0)

Senior Member from US 

WebmasterWorld Senior Member lucy24 is a WebmasterWorld Top Contributor of All Time Top Contributors Of The Month

joined:Apr 9, 2011
posts:12712
votes: 244


Yes, but not necessarily a huge one. If the URLs belong to real, physical directories, then the slashless version will redirect to where it belongs. Google will be slightly annoyed, but could be worse.

If on the other hand both versions are getting rewritten to serve the same content, then you will have Duplicate Content all over the place.

Calling two different things "canonical" does kinda, ahem, defeat the point of the "canonical" label ;)
12:47 pm on June 21, 2012 (gmt 0)

Senior Member

WebmasterWorld Senior Member g1smd is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:July 3, 2002
posts:18903
votes: 0


The canonical URL for a folder ends with a trailing slash.

The canonical URL for a page does not end with a trailing slash.

Notwithstanding the fact that a folder request without trailing slash should redirect to add a slash, when there are two URLs for the same piece of content, the canonical URL is usually the shorter one.
 

Join The Conversation

Moderators and Top Contributors

Hot Threads This Week

Featured Threads

Free SEO Tools

Hire Expert Members