You say you don't have a lot of experience with Photoshop and also mention paint Shop Pro. Are you fairly proficient in Paint Shop Pro? The buttons look pretty easy to duplicate. About a 2 px 50% black drop shadow bottom right, over a 5 px white drop shadow, bottom right. The font looks like one called something like Stuyvesant (spelling escapes me), common to some of the Corel font packs. It's an ICG font. Looks pretty darned close, anyway. I'd have to double check to make sure.
You'll need to create these on a similar colored background and make the background transparent. You can pretty much match up font sizes using the old images as a template. You can even get your color palette from the old images, as well.
As for the little icons, you can probably use something from a clip art CD.
<added>just fade the rollovers</added>