I´ve read a lot about Panda and WordPress sites... and I still have some doubt about WordPress tags....
Should we allow Google to index WordPress tags?
My site has over 4.000 post and over 11.000 tags.
If I search Google "site:example.com" mostly results in the first pages (90%) are WP tags.
If I search Google.com the exact title of one post, the first result is a tag -no the post- and also I get this:
In order to show you the most relevant results, we have omitted some entries very similar to the 3 already displayed.
If you like, you can repeat the search with the omitted results included.
I guess this mean the tags are been cosidered as duplicated content?
Actually my robot txt for the WordPress site is this:
Where as you can see I only disallow for tags the duplicated ones:
Should I just disallow all? like:
Also, and really dont know if it has relation with this problem, if I search example.com i get over 24,000 results indexed by Google.
If I see my WordPress Desktop:
All this is over 15,000 urls ... and indexed I see 24,000... yes I know there is Author pages, Date pages etc but not more than 1,000 I guess and also those should be restricted by above robot.txt... does it have any sense for you?
[edited by: tedster at 4:41 pm (utc) on Jul 16, 2012]
[edit reason] switch to example.com [/edit]