Maybe you just don't spend enough time working on SEO, social-marketing, brand-building, offline marketing...? How many business cards do you give out every week? How many people do you tell about your site? What help or advice do you give to people on your site which they can't get anywhere else? What makes people bookmark your site and tell their friends about it?