It is possible to achieve big traffic despite the small size of your website.
I can speak from experience, as my site has around 100 pages indexed by Google and averages about 30,000 visitors per day.
It can be done, although you need high quality links from trusted sources.
It took 5 years for me to achieve good traffic (10,000 a day) and in year 7 things really took off. I hope this trend continues, but I don't take anything for granted.
If you truly believe your site is of a high quality then email relevant sites for links. This is how I started 7 years ago and it got me off the mark. Now I don't request links as the site gets them naturally. Getting listing in the Open Directory Project was also a big help to me.