ASP Froogle-type Crawler?

Anyone building one of these and need help?

[ratebeer]

I'm looking for an ASP Froogle type crawler to grab product info and dump it into my database.

I'm just about to write my own and would not care to reinvent the wheel if I don't have to. Any pointers would be greatly appreciated. I can also help a work in progress.

[Easy_Coder]

I think you'd have to lean towards the custom solution. There's lots of crawlers out there but they aren't really information specific (grab price, manufacturer, color, attributes).

Perhaps a simple crawler just to do the page fetching... then you write the indexing routine?

[Easy_Coder]

oh, and I 'ratebeer' very highly!