Msg#: 4212736 posted 2:37 am on Oct 7, 2010 (gmt 0)
Twitter's real-time search engine was, until very recently, based on the technology that Summize originally developed.
[Now we have] a new, modern search architecture based on a highly efficient inverted index instead of a relational database.
With over 1,000 TPS (Tweets/sec) and 12,000 QPS (queries/sec) = over 1 billion queries per day (!) we already put a very high load on our machines.
We estimate that we're only using about 5% of the available backend resources, which means we have a lot of headroom. Our new indexer could also index roughly 50 times more Tweets per second than we currently get!
Msg#: 4212736 posted 7:18 pm on Oct 7, 2010 (gmt 0)
A+ for technology, D- for providing something useful to humanity (unless you like mostly regurgitated spam everywhere you look).
I was of the same opinion for a while on Twitter. These days, I'm careful who I follow. Basically, I only follow people who know a lot more than I do about things I'm interested in. I actually get a lot out of Twitter that way.
Msg#: 4212736 posted 2:14 am on Oct 8, 2010 (gmt 0)
For market insights and new content ideas, try regular monitoring of some Twitter searches about your market's keywords, for example "anyone know" [keyword] - returns common questions that your site can answer.
I just hope some of that new technical power to expand the time that data is available for search results.