old_expat - 3:36 am on Dec 24, 2006 (gmt 0)

>>say there are 10,000,000,000 web pages You don't need to index the web to make a good search engine - probably less than 0.1% of that amount is all it would take to answer about 99% of all queries.

A search on "digital cameras" claims 84,000,000 results.

But try to look at more than 1,000 of those results.

So how many pages do you actually need/use in a SE?