How Twitter Is Moving To the Cassandra Database

MyNoSQL has up an interview with Ryan King on how Twitter is transitioning to the Cassandra database. Here's some detailed background on Cassandra, which aims to "bring together Dynamo's fully distributed design and Bigtable's ColumnFamily-based data model." Before settling on Cassandra, the Twitter team looked into: "...HBase, Voldemort, MongoDB, MemcacheDB, Redis, Cassandra, HyperTable, and probably some others I'm forgetting. ... We're currently moving our largest (and most painful to maintain) table mdash; the statuses table, which contains all tweets and retweets. ... Some side notes here about importing. We were originally trying to use the BinaryMemtable interface, but we actually found it to be too fast mdash; it would saturate the backplane of our network. We've switched back to using the Thrift interface for bulk loading (and we still have to throttle it). The whole process takes about a week now. With infinite network bandwidth we could do it in about 7 hours on our current cluster." Relatedly, an anonymous reader notes that the upcoming NoSQL Live conference, which will take place in Boston March 11th, has announced their lineup of speakers and panelists including Ryan King and folks from LinkedIn, StumbleUpon, and Rackspace.pa href="http://developers.slashdot.org/story/10/02/23/1826226/How-Twitter-Is-Moving-To-the-Cassandra-Database?from=rss"img src="http://developers.slashdot.org/slashdot-it.pl?from=rssamp;op=imageamp;style=h0amp;sid=10/02/23/1826226"/a/ppa href="http://developers.slashdot.org/story/10/02/23/1826226/How-Twitter-Is-Moving-To-the-Cassandra-Database?from=rss"Read more of this story/a at Slashdot./ppa href="http://feedads.g.doubleclick.net/~at/OqHd_fkp7NWLwAKurvpjCUCKuIA/0/da"img src="http://feedads.g.doubleclick.net/~at/OqHd_fkp7NWLwAKurvpjCUCKuIA/0/di" border="0" ismap="true"/img/abr/a href="http://feedads.g.doubleclick.net/~at/OqHd_fkp7NWLwAKurvpjCUCKuIA/1/da"img src="http://feedads.g.doubleclick.net/~at/OqHd_fkp7NWLwAKurvpjCUCKuIA/1/di" border="0" ismap="true"/img/a/pimg src="http://feeds.feedburner.com/~r/Slashdot/slashdotDevelopers/~4/ezQ7tz4TsAo" height="1" width="1"/

More...