Datafeed Site and Updates...

to Update, or not to Update, that is the question !

[ilikeitraw]

I have a site which almost all of its content is generated dynamically by my database.
The Advertiser I'm working with updates their Product data daily, so I'm able to update my site daily if I wish as well.

So, would updating the site daily be a bad thing to do, in terms of spidering?
I'm wondering if a specific page gets spidered, then doesn't exist the next day, due to the product not existing on the Advertisers end.

Of course, I'm doing the updates ;)
Just something that crossed my mind.
Any ideas?

[ThomasB]

I'd suggest you doing the updates as often as you have to because of the merchants TOS. Also I'd suggest you to make sure that URLs are accessible for a longer timeframe than just 24 hours.