Site spiders to pull product feeds?

[suzanne]

Does anyone know of a tool that can spider a site and create a product data feed that can be customized for various purposes? The initial purpose would be to create a feed for an affiliate program, but ideally I would like a tool we can use for our clients that could also be used for various shopping portals, and potentially even search engines.

If anyone has heard of anything or has some advice, I'd love to hear it.

Thanks.

Suzanne

[cyberair]

I am looking for the same thing... I think. What I am looking for would be able to spider any website's product base and convert it into a feed. No luck so far, but hopefully someone here knows :-)

[Erku]

I am also looking something like that.

I have sent requests to amazon.com and drugstore.com to come up with similar scripts.

Thank you.

Armen

[dregs33]

Hi

A lot of the affilates on the major advertising networks provide data feeds.

They come in many formats csv, xml, webservices.

dregs33

[rfung]

I've created 'spiders' for page scraping - the problem with that is unless the merchant has an xml sort of data layout, you'll be scratching your head over trying to figure out which portion of a page is data and what is html code to be discarded.

It's really not hard to do some page scraping, if that's what you're refering to.