Indexing Data in SQL DB Question

[EliteWeb]

I'm working on a project where we are building a site to search the database. Right now the database we're using is the RDF and there is 3.x million entries. The part I'm at and concerned about is how well to index the data. Currently all the keywords are being populated into tables to be searched for and pull up the results.

The parts that are being indexed are as follows:

1. Title
2. Description
3. Domain Name
4. Category

Right now there are currently 15 million entries in the database for keywords because the first time the population of keywords was done it only did a certain % of the description and the full title. It did not do the FULL description, the category or domain name.

I'd like for everything to be indexed including the standard ignore words like 'the', and 'a' and 'an' and so forth, is this a bad move? I know it will take longer doing this but it seems all the sites do it now, they may exclude that word from a search phrase but its still indexed as you can find results with those words by forcing them to with the quotes.

But if we index all of these words it will take quite a bit more time. Right now it is doing about 1000 keywords a minute in the database. Any suggestions to speed this up, has any one had experiences in this matter?

Its being run on SQL server from a machine with 2 processors P4 and 2 gigs of ram and tons of HD space. We chose not to use FULL-TEXT-INDEXING feature in SQL as the DB would be too large and take much longer to pull results.

[DaveAtIFG]

Do any of you database veterans have any advice for EliteWeb? Help! :)