homepage Welcome to WebmasterWorld Guest from
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / Code, Content, and Presentation / RSS, ATOM, and Related Technologies
Forum Library, Charter, Moderators: bill & werty

RSS, ATOM, and Related Technologies Forum

Google and Yahoo News - Penalty?
Google doesn't like it. Y! Limits you...

10+ Year Member

Msg#: 65 posted 8:29 am on Jul 24, 2004 (gmt 0)

I have a fairly large site, with dozens of categories. I would like to display relevant news for each of the categories. The first thing that comes to mind is a Google script that I found that will return an RSS feed of Google news based on keywords. This is perfect, except that this is against Google's TOS, and they do not like 3rd party sites using their news content :( Found a similar way to create RSS feeds using keywords on Yahoo, but they turn off the connection after a certain amount of hits.

Where and how can I generate RSS feeds based on KW searches, with a huge database of news? I can collect the news myself, and store it in a DB, but it would be nowhere close to the capacity of Yahoo or Google. Any suggestions? I have some categories that are really obscure topics...



10+ Year Member

Msg#: 65 posted 2:05 pm on Jul 26, 2004 (gmt 0)

No need to scrape Yahoo for conversion to RSs as they provide the facility already at [news.yahoo.com...]


10+ Year Member

Msg#: 65 posted 3:57 pm on Jul 27, 2004 (gmt 0)

yahoo news is actually just reuters rebranded
and since they provide the original feeds, you'd be better off getting it straight from the source


I've actually gone the route you mentioned and have been creating a database of newsfeeds, it's been surprising how quickly it's growing. So, I wouldn't worry too much about getting enough content.

If you're interested, check out my site in my profile and steal some ideas ;)


10+ Year Member

Msg#: 65 posted 4:30 pm on Sep 5, 2004 (gmt 0)

Topix.net also has rss feeds you can use. Also, the google news script you're referring to wouldn't be gnews2rss, would it?

If so, it's kind of useless at this point because it only shows sorting by date. The author is working on a version that shows sorting by relevance, in which case it will become extremely useful.

Personally, I think Google should create an RSS news feed and distribute it to people in their adsense program. This way they still get advertising revenue. Win/Win.

Global Options:
 top home search open messages active posts  

Home / Forums Index / Code, Content, and Presentation / RSS, ATOM, and Related Technologies
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved