The email sent will contain a link to this article, the article title, and an article excerpt (if available). For security reasons, your IP address will also be included in the sent email.
It's HighScalability Time:
- 100PB : Facebook HDFS Cluster; One Trillion : Objects in S3
- Quotable quotes:
- @mwinkle : Listening to NASA big data challenges at #hadoopSummit, the square kilometer array project will produce 700tb per second. TB. Per second.
- @imrantech : #hadoopsummit @twitter - 400M tweets, 80-100TB per day
- @r39132 : At Netflix talk at #hadoopsummit : 2 B hours streamed in Q4 2011, 75% of the 30M daily movie starts are sourced from recommendations
- @nattybnatkins : Run job. Identify bottleneck. Address bottleneck. Repeat. Sage wisdom from @tlipcon on optimizing MR jobs #HadoopSummit
- @chiradeep : mainframe cost of operation - $5k per MIP per year #hadoopsummit
- @MCanalytics : #hadoopsummit Yahoo metrics - 140pb on 42k nodes with 500 users on 360k Hadoop jobs for 100b events/day Holy smokes!
- @M_Wein : Domain expertise is the wave of the future: it's more about "Hadoop and Healthcare" than "Using Bayesian counters with Hadoop" #hadoopsummit
- Twitter was an unexpected pleasure at the Hadoop Summit with many quality and interesting talks. Dmitriy Ryaboy in Twitter at the Hadoop Summit overviews the talks and points to what was talked about. I found the Large-scale machine learning at twitter very well done, not so much for the use of Pig, but for the process involved in mapping learning to creating non-iterative aggregators.
Don't miss all that the Internet has to say on Scalability, click below and become eventually consistent with all scalability knowledge...
Return to Article