homepage Welcome to WebmasterWorld Guest from
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / Code, Content, and Presentation / RSS, ATOM, and Related Technologies
Forum Library, Charter, Moderators: bill & werty

RSS, ATOM, and Related Technologies Forum

RSS Feed Aggregation with API

WebmasterWorld Senior Member 5+ Year Member

Msg#: 3815576 posted 2:58 pm on Dec 29, 2008 (gmt 0)


A section of my website needs to search updated content from among 50 websites and output results.

Now what I earlier had was parsing these RSS feeds every hour using a cron job(every hour) and storing them in my database and then executing the search function.

However, I am on a shared hosting and my host warned me against consuming too much bandwidth which this function is supposedly consuming. So, I am looking for an alternative way which can lessen the burden on bandwidth.

So, I was thinking if the RSS parsing can be done with the help of an API. I could not confirm if there is an official Google Reader API that can perform this.

Even if this is available, how do you suggest I perform the search function. Should I necessarily store it on my own database and perform the search function or is there an other way possible.

Thanks for your ideas.



WebmasterWorld Senior Member eelixduppy us a WebmasterWorld Top Contributor of All Time 5+ Year Member

Msg#: 3815576 posted 11:24 pm on Dec 29, 2008 (gmt 0)

It depends on how many searches you are making and whether or not there is an API for you to use. I do not think you can do searching with the Google Reader API, unfortunately, but you might want to look into it (and other options, as well). If you cannot use a search API, then you're stuck to searching through the content yourself, in which case you should store it in a temporary database as that will reduce your bandwidth. If you'd like to reduce your bandwidth right away changing the cron to every two hours will cut it in half (from this app, at least).

Global Options:
 top home search open messages active posts  

Home / Forums Index / Code, Content, and Presentation / RSS, ATOM, and Related Technologies
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved