Welcome to WebmasterWorld Guest from 50.19.135.67

Forum Moderators: bill & werty

Message Too Old, No Replies

RSS Feed Aggregation with API

     

anand84

2:58 pm on Dec 29, 2008 (gmt 0)

WebmasterWorld Senior Member 5+ Year Member



Hi

A section of my website needs to search updated content from among 50 websites and output results.

Now what I earlier had was parsing these RSS feeds every hour using a cron job(every hour) and storing them in my database and then executing the search function.

However, I am on a shared hosting and my host warned me against consuming too much bandwidth which this function is supposedly consuming. So, I am looking for an alternative way which can lessen the burden on bandwidth.

So, I was thinking if the RSS parsing can be done with the help of an API. I could not confirm if there is an official Google Reader API that can perform this.

Even if this is available, how do you suggest I perform the search function. Should I necessarily store it on my own database and perform the search function or is there an other way possible.

Thanks for your ideas.

eelixduppy

11:24 pm on Dec 29, 2008 (gmt 0)

WebmasterWorld Senior Member eelixduppy is a WebmasterWorld Top Contributor of All Time 5+ Year Member



It depends on how many searches you are making and whether or not there is an API for you to use. I do not think you can do searching with the Google Reader API, unfortunately, but you might want to look into it (and other options, as well). If you cannot use a search API, then you're stuck to searching through the content yourself, in which case you should store it in a temporary database as that will reduce your bandwidth. If you'd like to reduce your bandwidth right away changing the cron to every two hours will cut it in half (from this app, at least).
 

Featured Threads

Hot Threads This Week

Hot Threads This Month