homepage Welcome to WebmasterWorld Guest from
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Home / Forums Index / Code, Content, and Presentation / RSS, ATOM, and Related Technologies
Forum Library, Charter, Moderators: bill & werty

RSS, ATOM, and Related Technologies Forum

How to handle duplicates?
multiple rss feeds displaying duplicate articles

 3:58 am on Dec 17, 2008 (gmt 0)

Anyone know how to handle the problem? I have about 8 rss feeds piped into one rss feed however im getting duplicates in my results....most every title is listed twice sometimes three times...anyone know of a reader that can kill the duplicates maybe by compairing titles?

Im sure im not the first person to run into this....just cant seem to find a solution.

Any help would be greatly appreciated.



 10:29 am on Dec 19, 2008 (gmt 0)

would be good to show some code you are using to combine them


 3:13 pm on Dec 19, 2008 (gmt 0)

i just got this solved...i used yahoo pipes and fetched 8 feeds i had already set up by searching yahoo news and creating feeds....i then apllied a unique filter in pipes and it works like a charm...if anyone is reading this and having the same problem..check out yahoo pipes...build a pipe and fetch your feeds..then look under the operator tab and apply a unique filter..you can then check for duplicates by title,author,date,url...etc.....be sure and set the filter to your pipes before actually running the pipe...i didnt do this and for a few days i was thinking it wasnt checking for uniques becasue they kept showing up...however its a cache issue...takes about 30 mins for the unique filter to apply itself if it isnt installed on your pipe from creation.

there are ALOT of cool tools and i suspect you could do nearly anything you could think of with rss feeds if you spent some time getting familiar with the options.

i fed the output rss url for my pipes into a the built in feed display in joomla 1.5 and it works great.

Global Options:
 top home search open messages active posts  

Home / Forums Index / Code, Content, and Presentation / RSS, ATOM, and Related Technologies
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved