I would have to agree with Wheel here. It's really going to depend on your niche. I've seen some areas where great content and a handful of links will win the day and then visit those a couple years later and the story changed to where it's highly competitive for SEO.
You may want to continue doing what you are doing and also start pressing the gas on the SEO. FWIW.