Stuff The Internet Says On Scalability For January 14, 2011
Friday, January 14, 2011 at 9:29AM
HighScalability Team in hot links
Submitted for your reading pleasure...
On the new year Twitter set a record with 6,939 Tweets Per Second (TPS). Cool video visualizing New Year's Eve Tweet data across the world.
Marko Rodriguez in Memoirs of a Graph Addict: Despair to Redemption tells a stirring tale of how graph programming saved the world from certain destruction by realizing Aritstotle's dream of an eudaimonia-driven society. Could a relational database do that? The tools of the revolution can be found at tinkerprop.com, which describes a databases agnostic stack for working with property graphs, they include Blueprints - a property graph model interface; Pipes - a dataflow netowork using process grapphs; Gremlin - a graph based programming language; Rexster - a RESTful graph shell.
The never never ending battle of good versus evil has nothing on programmers arguing about bracket policies or sync vs async programming models. In this node.js thread, I love async, but I can't code like this, the battle continues. In the end programmers desire async, but leave the bar with sync.
Quotable Quotes
@AmyDeLong: Walked into a starbucks and overheard 3 separate discussions all on scalability. #firstworldproblems #onlyinsf
@chvest: You may not need "high" scalability, but you should still consider your growth rates and prepare.
@startthesignal: I'm looking for opinionated, angry, scalability experts for a panel session at the next #SMAQDown in Sydney http://j.mp/hlVAuL - pass it on
@hardwyrd: scale, scaling, scalable?, scalability, aspects of scalability?... in other words.. EH ?? ( add a blank facial expression - not mine :D )
NoSQL Tapes - A filmed compilation of interviews, explanations, and case studies. A wonderful curated list of resources done with a little style.
Distributed Caching Platforms by Anil Nori from the VLDB2010. Good general coverage of caching topics with an emphasis on Microsoft's AppFabric Caching. Talks about: What is "Distributed Caching?; Distributed Cache Usage; Types of Application Data; The Facebook Scenario; Extreme Transaction Processing. And a lot more...
Replication Under Scalable Hashing: A Family of Algorithms for Scalable Decentralized Data Distribution by R. J. Honicky and Ethan L. Miller. RUSH algorithms distribute objects to servers according to user-specified server weighting; redistribute as few objects as possible when new servers are added or existing servers are removed; guarantee that no two replicas of a particular object are ever placed on the same server; no central directory, clients can compute data locations in parallel, allowing thousands of clients to access objects on thousands of servers simultaneously.
How can we program these huge multi-core computers? Dmitriy Vyukov has started a new blog, 1024cores, to guide the way. It is devoted to lock-free, wait-free and just scalable synchronization algorithms, multicore, concurrency, parallel computations, scalability-oriented architecture, patterns and anti-patterns, threading technologies and libraries and related topics.
My Understanding of the TeleHash Protocol by quartzjer. TeleHash is a peer-to-peer protocol to create one always-on Distributed Hash Table (DHT) between all online TeleHash switches worldwide. We have to start thinking about how we'll link everything together.