Forum Moderators: Robert Charlton & goodroi
[google.com...]
Especially:
How does Blog Search work?Blog Search indexes blogs by their site feeds, which will be checked frequently for new content.
That Google is saying that if you want to be listed in their SERPS you will need to let them index your /feed/
However, many sites suggest to de-index /feed/ using robots.txt or noindex meta tags.
What are you ideas or experience?
However, many sites suggest to de-index /feed/ using robots.txt or noindex meta tags.
What you should do is <meta name="robots" content="FOLLOW, NOINDEX"> in the feed. You want to put that meta in a <channel>.
I would never do this in the robots.txt, you are asking for trouble if you do it wrong.
This way, Google picks up the blogs/articles... in the rss feed, but does not index the feed it self, which is useless in the SERP's.
I hope this helps,