tedster - 2:37 am on Oct 7, 2010 (gmt 0)

Twitter's real-time search engine was, until very recently, based on the technology that Summize originally developed. [Now we have] a new, modern search architecture based on a highly efficient inverted index instead of a relational database. With over 1,000 TPS (Tweets/sec) and 12,000 QPS (queries/sec) = over 1 billion queries per day (!) we already put a very high load on our machines. We estimate that we're only using about 5% of the available backend resources, which means we have a lot of headroom. Our new indexer could also index roughly 50 times more Tweets per second than we currently get! [engineering.twitter.com...]