Welcome to WebmasterWorld Guest from 22.214.171.124
There are [of course] a number of methods -- the built in SEF links (in configuration -> my store -- will probably require your own rewrite rules to match it) is one way, there's two or more similar tutorials in the oscommerce forums (which have an extremely bad search function) and there's a link transformer which I'll try and dig out of my URL bin :)
If the former (static URIs), you could use wget (or similar) to go a few levels deep and create the static pages and then use rewrites to change "dynamic urls" (at least to outward appearances before being rewritten) to point to your static pages.
I know some people using OSC use wget to create an entire static site every so often. They send spiders to crawl those pages and then rewrite the URIs to send visitors to the latest dynamic version of the page.
Also, you may be interested in the following Contributions
All Categories & Subcategories Page [oscommerce.com]
All Products Page [oscommerce.com]
If you are merely looking for SEF, check out
SEF Link Transformer [oscommerce.com]
Regarding the cahcing, see
I guess the question is what effect are you trying to achieve? In other words, why do you want to do it? That might change the "how".