Welcome to WebmasterWorld Guest from

Forum Moderators: bill & werty

Message Too Old, No Replies

RSS Feed Aggregation with API

2:58 pm on Dec 29, 2008 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Nov 15, 2005
posts: 744
votes: 0


A section of my website needs to search updated content from among 50 websites and output results.

Now what I earlier had was parsing these RSS feeds every hour using a cron job(every hour) and storing them in my database and then executing the search function.

However, I am on a shared hosting and my host warned me against consuming too much bandwidth which this function is supposedly consuming. So, I am looking for an alternative way which can lessen the burden on bandwidth.

So, I was thinking if the RSS parsing can be done with the help of an API. I could not confirm if there is an official Google Reader API that can perform this.

Even if this is available, how do you suggest I perform the search function. Should I necessarily store it on my own database and perform the search function or is there an other way possible.

Thanks for your ideas.

11:24 pm on Dec 29, 2008 (gmt 0)

Senior Member

WebmasterWorld Senior Member eelixduppy is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:Nov 12, 2005
votes: 0

It depends on how many searches you are making and whether or not there is an API for you to use. I do not think you can do searching with the Google Reader API, unfortunately, but you might want to look into it (and other options, as well). If you cannot use a search API, then you're stuck to searching through the content yourself, in which case you should store it in a temporary database as that will reduce your bandwidth. If you'd like to reduce your bandwidth right away changing the cron to every two hours will cut it in half (from this app, at least).