Welcome to WebmasterWorld Guest from

Forum Moderators: bill & werty

Message Too Old, No Replies

Google and Yahoo News - Penalty?

Google doesn't like it. Y! Limits you...

8:29 am on Jul 24, 2004 (gmt 0)

Junior Member

10+ Year Member

joined:Mar 7, 2003
votes: 0

I have a fairly large site, with dozens of categories. I would like to display relevant news for each of the categories. The first thing that comes to mind is a Google script that I found that will return an RSS feed of Google news based on keywords. This is perfect, except that this is against Google's TOS, and they do not like 3rd party sites using their news content :( Found a similar way to create RSS feeds using keywords on Yahoo, but they turn off the connection after a certain amount of hits.

Where and how can I generate RSS feeds based on KW searches, with a huge database of news? I can collect the news myself, and store it in a DB, but it would be nowhere close to the capacity of Yahoo or Google. Any suggestions? I have some categories that are really obscure topics...

2:05 pm on July 26, 2004 (gmt 0)

Full Member

10+ Year Member

joined:Aug 21, 2003
votes: 4

No need to scrape Yahoo for conversion to RSs as they provide the facility already at [news.yahoo.com...]
3:57 pm on July 27, 2004 (gmt 0)

New User

10+ Year Member

joined:July 27, 2004
votes: 0

yahoo news is actually just reuters rebranded
and since they provide the original feeds, you'd be better off getting it straight from the source


I've actually gone the route you mentioned and have been creating a database of newsfeeds, it's been surprising how quickly it's growing. So, I wouldn't worry too much about getting enough content.

If you're interested, check out my site in my profile and steal some ideas ;)

4:30 pm on Sept 5, 2004 (gmt 0)

Preferred Member

10+ Year Member

joined:May 12, 2004
votes: 0

Topix.net also has rss feeds you can use. Also, the google news script you're referring to wouldn't be gnews2rss, would it?

If so, it's kind of useless at this point because it only shows sorting by date. The author is working on a version that shows sorting by relevance, in which case it will become extremely useful.

Personally, I think Google should create an RSS news feed and distribute it to people in their adsense program. This way they still get advertising revenue. Win/Win.


Join The Conversation

Moderators and Top Contributors

Hot Threads This Week

Featured Threads

Free SEO Tools

Hire Expert Members