It took us forever to get IE to play using the audio tag. I'd bet you find out the problem lies in how it's encoded. Anything can play your video but IE but once you figure out the magic pixie dust, everything will play just fine. The problem is, finding out where the magic pixie dust is.
Writing code for IE is like adjusting a rabbit ear antenna for a TV.