Page is a not externally linkable
- Search Engines
-- Alternative Search Engines
---- Matt Wells interview


ByronM - 3:02 pm on May 13, 2004 (gmt 0)


500k queries a day is roughly 6 queries per second.. not too shabby.

6 queries per second and 250 million pages is comparible to nutch/lucene on 10 servers if you tweak out the configuration well enough.. You have to figure that even a good percentage of the queries can be cached by os based on trends as not every query is unique.

However 40 queries per second seems a little high.. i can squeeze that through nutch running a benchmark program based on dictionary terms (As they would be cached "warmed up" over time)

When you do 40queries per second, is that single term or with joins, an "and" or "or" type query?


Thread source:: http://www.webmasterworld.com/alternative_search_engines/1397.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com