Last Monday @federicoboerr mentioned, in a customer internal email list, the importance of considering scalability in most projects. So, I prepared this list of links about the topic (as usual, they were curated using my delicious). Enjoy!
http://en.wikipedia.org/wiki/Scalability
In electronics (including hardware, communication and software) scalability is the ability of a system, network, or process, to handle growing amounts of work in a graceful manner or its ability to be enlarged to accommodate that growth.[1] For example, it can refer to the capability of a system to increase total throughput under an increased load when resources (typically hardware) are added.
Scalability Rules
http://scalabilityrules.com/
via @federicoboerr
High Scalability
http://highscalability.com/
Stuff The Internet Says On Scalability For August 5, 2011
http://highscalability.com/blog/2011/8/5/stuff-the-internet-says-on-scalability-for-august-5-2011.html
Wikimedia architecture
http://highscalability.com/wikimedia-architecture
Wikimedia is the platform on which Wikipedia, Wiktionary, and the other seven wiki dwarfs are built on.
HPCC Systems | Open-source. Fast. Scalable. Simple.
http://hpccsystems.com/
Tweaking WCF to build highly scalable async REST API
http://omaralzabir.com/tweaking-wcf-to-build-highly-scalable-async-rest-api
Architecture of Tankster– Scale (Part 2) | Nathan Totten
http://ntotten.com/2011/07/architecture-of-tankster-scale-part-2/
Architecture of Tankster – Introduction to Game Play (Part 1) | Nathan Totten
http://ntotten.com/2011/07/architecture-of-tankster-introduction-to-game-play-part-1/
NoSQL is a Premature Optimization « SmoothSpan Blog
http://smoothspan.wordpress.com/2011/07/22/nosql-is-a-premature-optimization/
Nati Shalom’s Blog: Scale-out vs Scale-up
http://natishalom.typepad.com/nati_shaloms_blog/2010/09/scale-up-vs-scale-out.html
Azurescope: Best Practices for Developing on Window Azure
http://azurescope.cloudapp.net/BestPractices/
High Scalability – High Scalability – 35+ Use Cases for Choosing Your Next NoSQL Database
http://highscalability.com/blog/2011/6/20/35-use-cases-for-choosing-your-next-nosql-database.html
The Art of Scalability
http://theartofscalability.com/
Pusher is a hosted API for quickly, easily and securely adding scalable realtime functionality via WebSockets to web and mobile apps
http://pusher.com/
mnot’s blog: On HTTP Load Testing
http://www.mnot.net/blog/2011/05/18/http_benchmark_rules
10 rules for scalable performance in ‘simple operation’ datastores | June 2011 | Communications of the ACM
http://cacm.acm.org/magazines/2011/6/108651-10-rules-for-scalable-performance-in-simple-operation-datastores/fulltext
HDFS: Realtime Hadoop usage at Facebook — Part 1
http://hadoopblog.blogspot.com/2011/05/realtime-hadoop-usage-at-facebook-part.html
High Scalability – Zynga’s Z Cloud – Scale Fast or Fail Fast by Merging Private and Public Clouds
http://highscalability.com/blog/2011/5/19/zyngas-z-cloud-scale-fast-or-fail-fast-by-merging-private-an.html
High Scalability – Did the Microsoft Stack Kill MySpace?
http://highscalability.com/blog/2011/3/25/did-the-microsoft-stack-kill-myspace.html
High Scalability – 6 Lessons from Dropbox – One Million Files Saved Every 15 minutes
http://highscalability.com/blog/2011/3/14/6-lessons-from-dropbox-one-million-files-saved-every-15-minu.html
InfoQ: Scaling with MongoDB
http://www.infoq.com/presentations/Scaling-with-MongoDB
High Scalability – A Practical Guide to Varnish – Why Varnish Matters
http://highscalability.com/blog/2011/2/28/a-practical-guide-to-varnish-why-varnish-matters.html
Tagged Architecture – Scaling to 100 Million Users, 1000 Servers, and 5 Billion Page Views
http://highscalability.com/blog/2011/8/8/tagged-architecture-scaling-to-100-million-users-1000-server.html
Spain Scalability Group
https://sites.google.com/site/spainscalabilitygroup
Systems We Make
http://www.systemswemake.com/
High Scalability – Paper: An Experimental Investigation of the Akamai Adaptive Video Streaming
http://highscalability.com/blog/2011/2/16/paper-an-experimental-investigation-of-the-akamai-adaptive-v.html
Pensamientos ágiles: Grupo sobre escalabilidad en español
http://brigomp.blogspot.com/2011/02/grupo-sobre-escalabilidad-en-espanol.html
Patterns for Building Scalable and Reliable Applications with Windows Azure
http://www.microsoftpdc.com/2009/SVC08
Windows Azure Storage Abstractions and their Scalability Targets
http://blogs.msdn.com/b/windowsazurestorage/archive/2010/05/10/windows-azure-storage-abstractions-and-their-scalability-targets.aspx
High Scalability – Pinboard.in Architecture – Pay to Play to Keep a System Small
http://highscalability.com/blog/2010/12/29/pinboardin-architecture-pay-to-play-to-keep-a-system-small.html
Agile Wiki : The open source Web Application Framework that just Scales!
http://agilewiki.org/templates
High Scalability – What the heck are you actually using NoSQL for?
http://highscalability.com/blog/2010/12/6/what-the-heck-are-you-actually-using-nosql-for.html
Autoscaling in Windows Azure
http://convective.wordpress.com/2010/10/12/autoscaling-in-windows-azure/
Windows Azure Dynamic Scaling with AzureWatch
http://www.paraleap.com/AzureWatch/Instructions
InfoQ: LMAX – How to Do 100K TPS at Less than 1ms Latency
http://www.infoq.com/presentations/LMAX
Azul’s Pauseless Garbage Collector
http://www.artima.com/lejava/articles/azul_pauseless_gc.html
My thesis – building blocks of a scalable webcrawler – Marc’s Blog
http://blog.marc-seeger.de/2010/12/09/my-thesis-building-blocks-of-a-scalable-webcrawler
High Scalability – 7 Design Patterns for Almost-infinite Scalability
http://highscalability.com/blog/2010/12/16/7-design-patterns-for-almost-infinite-scalability.html
InfoQ: The Evolution of the Flickr Architecture
http://www.infoq.com/presentations/Flickr-Architecture
Apex Code: The World’s First On-Demand Programming Language – developer.force.com
http://wiki.developerforce.com/index.php/Apex_Code:_The_World%27s_First_On-Demand_Programming_Language
InfoQ: Abstractions at Scale–Our Experiences at Twitter
http://www.infoq.com/presentations/Abstractions-at-Scale
You don’t scale a multi tenant environment
http://ayende.com/Blog/archive/2010/12/12/you-donrsquot-scale-a-mutli-tenant-environment.aspx
InfoQ: Scaling Australia’s Most Popular Online News Sites with Ehcache
http://www.infoq.com/presentations/ehcache-newscorp-australia
High Scalability – GPU vs CPU Smackdown : The Rise of Throughput-Oriented Architectures
http://highscalability.com/blog/2010/12/3/gpu-vs-cpu-smackdown-the-rise-of-throughput-oriented-archite.html
Performance Testing – Response vs. Latency vs. Throughput vs. Load vs. Scalability vs. Stress vs. Robustness « Niraj Bhatt – Architect’s Blog
http://nirajrules.wordpress.com/2009/09/17/measuring-performance-response-vs-latency-vs-throughput-vs-load-vs-scalability-vs-stress-vs-robustness/
High Scalability – Great Introductory Video on Scalability from Harvard Computer Science
http://highscalability.com/blog/2010/11/24/great-introductory-video-on-scalability-from-harvard-compute.html
Scalability and the Relational Model « Experimental Thoughts
http://thoughts.j-davis.com/2010/03/07/scalability-and-the-relational-model/
Thinking about massively parallel Smalltalk
http://wiki.squeak.org/squeak/537
Pragmatic Programming Techniques: Scalable System Design Patterns
http://horicky.blogspot.com/2010/10/scalable-system-design-patterns.html
Yoshinori Matsunobu’s blog: Using MySQL as a NoSQL – A story for exceeding 750,000 qps on a commodity server
http://yoshinorimatsunobu.blogspot.com/2010/10/using-mysql-as-nosql-story-for.html
Cómo soporta Facebook 500M de usuarios | jmchia.com
http://jmchia.com/2010/09/estrategias-de-escalado-facebook/
How Facebook Scales with Open Source – ReadWriteCloud
http://www.readwriteweb.com/cloud/2010/08/how-facebook-scales-with-open.php
High Scalability – Hilarious Video: Relational Database vs NoSQL Fanbois
http://highscalability.com/blog/2010/9/5/hilarious-video-relational-database-vs-nosql-fanbois.html
Designing Web Applications for Scalability
http://www.osconvo.com/post/view/2010/8/12/designing-web-applications-for-scalability
High Scalability – Designing Web Applications for Scalability
http://highscalability.com/blog/2010/8/12/designing-web-applications-for-scalability.html
High Scalability – 7 Scaling Strategies Facebook Used to Grow to 500 Million Users
http://highscalability.com/blog/2010/8/2/7-scaling-strategies-facebook-used-to-grow-to-500-million-us.html
My Links
http://www.delicious.com/ajlopez/scalability
Keep tuned!
Angel “Java” Lopez
http://www.ajlopez.com
http://twitter.com/ajlopez