Welcome to WebmasterWorld Guest from 54.144.246.252

WP - index the Feed or not?

Google says yes if you want SERPS

   
1:01 am on Jun 4, 2007 (gmt 0)

10+ Year Member



It seems to me from this page:

[google.com...]

Especially:

How does Blog Search work?

Blog Search indexes blogs by their site feeds, which will be checked frequently for new content.

That Google is saying that if you want to be listed in their SERPS you will need to let them index your /feed/

However, many sites suggest to de-index /feed/ using robots.txt or noindex meta tags.

What are you ideas or experience?

4:05 am on Jun 5, 2007 (gmt 0)

5+ Year Member



Have you checked first to see if you are already being indexed by Google's Blog Search?

I don't allow Google to index my basic feed, but I do give them access to my FeedBurner feed. Hasn't seemed to cause any kind of problem, and I'm definitely listed in Blog Search.

5:15 am on Jun 5, 2007 (gmt 0)

10+ Year Member



However, many sites suggest to de-index /feed/ using robots.txt or noindex meta tags.

What you should do is <meta name="robots" content="FOLLOW, NOINDEX"> in the feed. You want to put that meta in a <channel>.

I would never do this in the robots.txt, you are asking for trouble if you do it wrong.

This way, Google picks up the blogs/articles... in the rss feed, but does not index the feed it self, which is useless in the SERP's.

I hope this helps,

 

Featured Threads

Hot Threads This Week

Hot Threads This Month