homepage Welcome to WebmasterWorld Guest from 54.226.10.234
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / Code, Content, and Presentation / RSS, ATOM, and Related Technologies
Forum Library, Charter, Moderators: bill & werty

RSS, ATOM, and Related Technologies Forum

    
Need help setting up rss feeds properly for search engines
robots.txt, nofollow and noindex
pavlovapete

5+ Year Member



 
Msg#: 3301770 posted 5:29 am on Apr 4, 2007 (gmt 0)

Hi all,

I'm using the rd_rss component with the Joomla CMS to produce rss feeds. I do not want the search engines to index my feeds - I'm a bit worried about duplicate content issues. I'd like to do the following and hope you can tell me if I am on the right track.

1: Disallow: index.php?option=com_rd_rss&id=4 in the robots.txt file -should I specify the file exactly like this?
2: add rel="nofollow" on all internal site links to my feeds
3: somehow add <meta name="robots" content="noindex, nofollow" /> to the xml feed itself - can I mix a meta tag with the xml rss feed and will this work?

Should I xsl style the xml or make the feed HTML just in case a search engine indexes the feed and a user clicks into the feed?

Thaks for any advice

Cheers

 

bill

WebmasterWorld Administrator bill us a WebmasterWorld Top Contributor of All Time 10+ Year Member



 
Msg#: 3301770 posted 5:51 am on Apr 4, 2007 (gmt 0)

If RSS feeds were considered duplicate content and penalized by any search engines then you'd hear a lot more about it, believe me.

robots.txt

If you deny your feed to all robots then it won't get indexed in the RSS/blog search engines either...if they follow the robots.txt standard in the first place.

add rel="nofollow" on all internal site links to my feeds

The nofollow attribute doesn't mean that links aren't followed and indexed. It just shows that you don't trust the link and that the SEs shouldn't pass along any link-love to the target. I've never heard of this being used for RSS/XML links.

pavlovapete

5+ Year Member



 
Msg#: 3301770 posted 10:25 pm on Apr 4, 2007 (gmt 0)

OK Bill,

thanks. Guess I will not worry too much about it.

Cheers

[edited by: encyclo at 11:02 pm (utc) on April 4, 2007]
[edit reason] thread splice [/edit]

traveldude

5+ Year Member



 
Msg#: 3301770 posted 7:43 pm on Apr 5, 2007 (gmt 0)

I've stayed away from RSS feeds because of duplicate content concerns. If there is no penalty, that begs the question does adding a feed help SEO ranking?

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Code, Content, and Presentation / RSS, ATOM, and Related Technologies
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved