grab content from a website

[ictglobal]

I want to pick news from a website such that my site is updated as soon as the link is updated. For example has a news on their homepage, and I would like that news headlines to appear on my page but with my own formatting.When a user clicks,the news should open in my ownpage and not yahoo.

I hear they call it content syndication or something.

Any help

[pleeker]

Welcome to WebmasterWorld.

In order to do this, the site you want to use headlines from has to first make their headlines available to you -- this is usually done via an RSS/XML or even javascript headline feed. Look for information about this on the site in question to find out if they offer it, and how to integrate it into your site. It's often as easy as pasting a line of code on your page(s).

If the site you want to borrow from doesn't offer this, you're basically out of luck. You can't "grab content" from a site without their permission.

[rogerdp]

Well, you can. It's just unethical, difficult, and very likely unlawful. :P

[walkman]

"the news should open in my ownpage and not yahoo"
I assume you got the re-printing right from AP, Reuters, AFP, Wash Post, NYT and 100's of other content providers like Y! did.

[john_k]

I hear they call it content syndication or something.

Content syndication is when the originator of the content makes it available to others - either for free or for a fee. In that case, you will be able to get easy instructions from them on how to integrate the content with your site.

The process you have described, scraping data from other sites and repackaging it as your own original material, is more likely content theft.

[rogerd]

Typically, sites that offer free syndication feed you headlines and short descriptions, but readers who click to read more end up on the that site. You may be able to pay for syndicating full articles from some sites.

You might also be able to frame the content to allow users to navigate your site even after clicking on a "read more" link - read the terms of use for the feed to be sure this isn't a problem.