@jreichhold: One thing working at Twitter teaches me daily is that all scale is relative. What seemed impossible last year is now the daily case.
@dannycast0nguay: If you’re concerned about scalability, any algorithm that forces you to run agreement will eventually become your bottleneck.—Werner Vogels
@sramji: Caching is for scalability, not for speed. Your cache *will* break and if your backend is not fast you are sunk. - Dan Hobbs #apimeetup
@joestump: OH: "I love the smell of data redundancy with automatic failover in the morning."
Scalability Porn:
Storage, you ain't seen nothing yet, wait until every smart phone is equipped with a new gigapixel camera. These new one billion plus pixel images will take upwards of 30GB to store.
How big is the Internet? Awesome inforgraphic by The Next Web on the size of the web. It's definitely bigger than a bread box.
Jeremy Zawodny with an detailed explanation of how Craigslist implements sharding on Redis using 10 hosts and 120GB of RAM.
Volley: Automated Data Placement for Geo-Distributed Cloud Services. Murat Demirbas with great coverage on a paper by Microsoft Research on a heuristic strategy for data placement to geo-distributed datacenters. The evaluations show that Volley converged after a small number of iterations, and reduced skew by 2x, inter-datacenter traffic by 1.8x, and latency by 30%.
Death match! EBS versus SSD price, performance, and QoS. Baron Schwartz with ring side commentary finding in a knock-down-drag-out fight between the EBS gang and the SSD thugs, a small number of SSDs mops the floor with the competition, and walks away with the prize.
In a world where algorithms are for people who don't know how to buy RAM, isn't 24 Gigabytes of Memory Ought to be Enough for Anybody? Jeff Atwood observes: To me, it's more about no longer needing to think about memory as a scarce resource, something you allocate carefully and manage with great care. There's just .. lots.
Scott Lystig Fritchie with a nicely detailed report on Webmail for Millions, Powered by Erlang: The architecture and lessons learned implementing a webmail system in Erlang, using UBF and Hibari, a distributed key-value store, to accommodate a large user base.
On the Engineering of SaaS. Theo Schlossnagle shares insight into what’s in store for you as you transition from a software company into a SaaS company: A customer of one; You aren’t a software company anymore; Continuous Deployment; Quality Assurance is now a continuous process; Multi-tenancy design.
Ruby on Rails: Scaling Your App for Rapid Growth. Jolie O'Dell interviews Gowalla CTO and co-founder Scott Raymond on their experiences with RoR. So, as a developer for a popular service, the challenge becomes trying to foresee which actions will be the most frequently requested, which data types will be the fastest growing, and which actions are the most performance-sensitive.
Don't look now, but Google has replaced your HTTP with SPDY. Don't worry, it's good for you. SPDY is an experiment with protocols for the web. Its goal is to reduce the latency of web pages.
Packet Pushers on Breaking the Three Layer Model. Is this the point we start to re-think the 3 Layers of Network Architecture, will the future generation laugh at core, distribution and access designs? Yes.
Baron Schwartz runs some benchmarks to test Is VoltDB really as scalable as they claim? The answer is yes: I’ll tell you: scaling a synchronously replicated, active-active master, fully ACID, always-consistent database to a 40-server cluster is impressive.
Article originally appeared on (http://highscalability.com/).
See website for complete article licensing information.