Welcome to WebmasterWorld Guest from 174.129.127.214

Forum Moderators: bill & werty

Message Too Old, No Replies

Google and Yahoo News - Penalty?

Google doesn't like it. Y! Limits you...

   
8:29 am on Jul 24, 2004 (gmt 0)

10+ Year Member



I have a fairly large site, with dozens of categories. I would like to display relevant news for each of the categories. The first thing that comes to mind is a Google script that I found that will return an RSS feed of Google news based on keywords. This is perfect, except that this is against Google's TOS, and they do not like 3rd party sites using their news content :( Found a similar way to create RSS feeds using keywords on Yahoo, but they turn off the connection after a certain amount of hits.

Where and how can I generate RSS feeds based on KW searches, with a huge database of news? I can collect the news myself, and store it in a DB, but it would be nowhere close to the capacity of Yahoo or Google. Any suggestions? I have some categories that are really obscure topics...

2:05 pm on Jul 26, 2004 (gmt 0)

10+ Year Member



No need to scrape Yahoo for conversion to RSs as they provide the facility already at [news.yahoo.com...]
3:57 pm on Jul 27, 2004 (gmt 0)

10+ Year Member



yahoo news is actually just reuters rebranded
and since they provide the original feeds, you'd be better off getting it straight from the source

[reuters.com...]

I've actually gone the route you mentioned and have been creating a database of newsfeeds, it's been surprising how quickly it's growing. So, I wouldn't worry too much about getting enough content.

If you're interested, check out my site in my profile and steal some ideas ;)

4:30 pm on Sep 5, 2004 (gmt 0)

10+ Year Member



Topix.net also has rss feeds you can use. Also, the google news script you're referring to wouldn't be gnews2rss, would it?

If so, it's kind of useless at this point because it only shows sorting by date. The author is working on a version that shows sorting by relevance, in which case it will become extremely useful.

Personally, I think Google should create an RSS news feed and distribute it to people in their adsense program. This way they still get advertising revenue. Win/Win.