Depends how pretty you want the html page to be. Any text editor that does Regular Expressions should be able to crank it out for you. Including fancy business for different directories, if that's the kind of thing you want.
PROBLEM. Your sitemap-- in any form-- only gives the filename for each page. For humans you will probably want to use the page title instead. And that brings you into a whole new layer of complicatedness.