Welcome to WebmasterWorld Guest from 220.127.116.11
Twitter's real-time search engine was, until very recently, based on the technology that Summize originally developed.
[Now we have] a new, modern search architecture based on a highly efficient inverted index instead of a relational database.
With over 1,000 TPS (Tweets/sec) and 12,000 QPS (queries/sec) = over 1 billion queries per day (!) we already put a very high load on our machines.
We estimate that we're only using about 5% of the available backend resources, which means we have a lot of headroom. Our new indexer could also index roughly 50 times more Tweets per second than we currently get!
A+ for technology, D- for providing something useful to humanity
A+ for technology, D- for providing something useful to humanity (unless you like mostly regurgitated spam everywhere you look).