| Welcome to WebmasterWorld Guest from 126.96.36.199 |
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
|Become a Pro Member|
|WP - index the Feed or not?|
Google says yes if you want SERPS
| 1:01 am on Jun 4, 2007 (gmt 0)|
It seems to me from this page:
|How does Blog Search work? |
Blog Search indexes blogs by their site feeds, which will be checked frequently for new content.
That Google is saying that if you want to be listed in their SERPS you will need to let them index your /feed/
However, many sites suggest to de-index /feed/ using robots.txt or noindex meta tags.
What are you ideas or experience?
| 4:05 am on Jun 5, 2007 (gmt 0)|
Have you checked first to see if you are already being indexed by Google's Blog Search?
I don't allow Google to index my basic feed, but I do give them access to my FeedBurner feed. Hasn't seemed to cause any kind of problem, and I'm definitely listed in Blog Search.
| 5:15 am on Jun 5, 2007 (gmt 0)|
|However, many sites suggest to de-index /feed/ using robots.txt or noindex meta tags. |
What you should do is <meta name="robots" content="FOLLOW, NOINDEX"> in the feed. You want to put that meta in a <channel>.
I would never do this in the robots.txt, you are asking for trouble if you do it wrong.
This way, Google picks up the blogs/articles... in the rss feed, but does not index the feed it self, which is useless in the SERP's.
I hope this helps,
All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved