Hot Scalability Links for April 16, 2010
Friday, April 16, 2010 at 7:15AM
HighScalability Team

- Twitter gets a total of 3 billion requests a day via its API; 105,779,710 registered users; 300,000 new registered users a day; 180 million unique visitors a month; 55 million tweets a day.
- Who has the most servers? Google 1 million+; Intel 100K; 1&1 Internet 70K; Facebook 30K; Akamai 61K; Rackspace 56k+.
- Cloud Computing Economies of Scale. James Hamilton gives a fabulous talk breaking down where the costs are in the cloud. It's not where you may think. Higher utilization is the key. More here.
- Erlang Factory: Andy Gross: Distributed Erlang Systems In Operation: Patterns and Pitfalls by Martin J. Logan. Great overview of architecting distributed systems in Erlang. Covers what you want and don't want in a distributed system and how to compromise those elements, what's common, system design, cluster membership, load balancing, upgrades, debugging, and more.
- Extreme Scale Computing by Irving Wladawsky-Berger. “An exascale supercomputer capable of a million trillion calculations per second – dramatically increasing our ability to understand the world around us through simulation and slashing the time needed to design complex products such as therapeutics, advanced materials, and highly-efficient autos and aircraft.”
- MMT: Exploiting Fine-Grained ParallelisminDynamic Memory Management by lots of people from North Carolina State University. We show that an efficient MMT design can give significant performance improvement by extracting parallelism.
- Ruby Scales, AND It’s Fast – If You Do It Right! by Kirk Haines. The secret to keeping things fast: Do one thing at a time, do it well enough, and then move on.
- Swarm-dpl. A transparently scalable distributed programming language allowing the creation of web applications which can scale transparently through a novel portable continuation-based approach. Swarm embodies the maxim "move the computation, not the data".
- How to Build Stable Google App Engine Apps and sleep better at night by Waleed Abdulla. Be ready, shift happens and App Engine has restrictions. Be Ready. Write good error handling. Update at night. Email critical errors. Backup data.
- Gear6 makes memcached infrastructure lower cost on cloud. Patented Robert Scoble interview with Gear6. What makes us different is that we are extending memcache in obvious ways to make it more useful to people and at the same time we are deploying it to real people and getting real feedback on how it works.
- How Raytheon Researchers are Using Hadoop to Build a Scalable, Distributed Triple Store by Kurt Rohloff. Due to the inherent scalability of the Hadoop and HDFS approach in SHARD, the SHARD triple-store could potentially be used for extremely large datasets (trillions of triples). Also nice description of the query process.
- Infinite web scalability & resilience with Amazon Web Services. Wille Faler provides a simple overview of how to serve semi-dynamic web content with almost infinite horizontal scalability and resilience using Amazon Web Services, with the added boon of making server restores a non-issue.
- Availability and Partition Tolerance by Jeff Darcy. A great discussion of Eric Brewer’s CAP Theorem. You will come away both edified and confused.
- Cassandra Architecutre Internals
New Releases
Events
- Social Developer Summit - June 29, San Francisco. Whether it's social games, social news, social discovery, social search, or other forms of social solutions, developers today are facing new hurdles in building instantly scalable products. The first Social Developer Summit will bring together social application developers to discuss the challenges, solutions, and best practices for building applications in the rapidly expanding social web economy. At the Social Developer Summit, industry experts will share tips and case studies for building high performance social web products.
If you would like to advertise a product, job, or event, please contact us for more information.
Article originally appeared on (http://highscalability.com/).
See website for complete article licensing information.