Category Archives: Software Architecture

Scalability: Links, News And Resources (7)

Previous Post

What Does Your Webserver Do When a User Hits Refresh? — Ecommerce Blog by Shopify
http://www.shopify.com/technology/7535298-what-does-your-webserver-do-when-a-user-hits-refresh#axzz2O1D5ZhXG

VMware vFabric GemFire: High Performance Data Management for Cloud-Based Applications
http://www.vmware.com/products/application-platform/vfabric-gemfire

Indeed Engineering Blog » Blog Archive » From 1 to 1 Billion: Evolution of a Document Serving System
http://engineering.indeed.com/blog/2013/03/from-1-to-1-billion-part-1/

Scaling Node.js Applications | Colin J. Ihrig’s Blog
http://cjihrig.com/blog/scaling-node-js-applications/

Facebook kisses DRAM goodbye, builds memcached for flash — Tech News and Analysis
http://gigaom.com/2013/03/05/facebook-kisses-dram-goodbye-builds-memcached-for-flash/

Splout SQL
http://sploutsql.com/
MapReduce, using Pangool, from Spain

Pomelo home
http://pomelo.netease.com/

NetEase/pomelo · GitHub
https://github.com/NetEase/pomelo
Game development with Node.js

Scaling Facebook Engineering
http://www.infoq.com/presentations/Scaling-Facebook-Engineering

(10) Needle in a haystack: efficient storage of billions of photos
https://www.facebook.com/note.php?note_id=76191543919

Fully Loaded Node – A Node.JS Holiday Season, part 2 ✩ Mozilla Hacks – the Web developer blog
https://hacks.mozilla.org/2012/11/fully-loaded-node-a-node-js-holiday-season-part-2/

Structure:Data | GigaOM Events
http://event.gigaom.com/structuredata/

My Links
http://delicious.com/ajlopez/scalability

Keep tuned!

Angel “Java” Lopez
http://www.ajlopez.com
http://twitter.com/ajlopez

Scalability: Links, News And Resources (6)

Previous Post
Next Post

What Does Your Webserver Do When a User Hits Refresh? — Ecommerce Blog by Shopify
http://www.shopify.com/technology/7535298-what-does-your-webserver-do-when-a-user-hits-refresh#axzz2O1D5ZhXG

VMware vFabric GemFire: High Performance Data Management for Cloud-Based Applications
http://www.vmware.com/products/application-platform/vfabric-gemfire

Indeed Engineering Blog » Blog Archive » From 1 to 1 Billion: Evolution of a Document Serving System
http://engineering.indeed.com/blog/2013/03/from-1-to-1-billion-part-1/

Scaling Node.js Applications | Colin J. Ihrig’s Blog
http://cjihrig.com/blog/scaling-node-js-applications/

Facebook kisses DRAM goodbye, builds memcached for flash — Tech News and Analysis
http://gigaom.com/2013/03/05/facebook-kisses-dram-goodbye-builds-memcached-for-flash/

Splout SQL
http://sploutsql.com/
MapReduce, using Pangool, from Spain

Pomelo home
http://pomelo.netease.com/

NetEase/pomelo · GitHub
https://github.com/NetEase/pomelo
Game development with Node.js

Scaling Facebook Engineering
http://www.infoq.com/presentations/Scaling-Facebook-Engineering

(10) Needle in a haystack: efficient storage of billions of photos
https://www.facebook.com/note.php?note_id=76191543919

Fully Loaded Node – A Node.JS Holiday Season, part 2 ✩ Mozilla Hacks – the Web developer blog
https://hacks.mozilla.org/2012/11/fully-loaded-node-a-node-js-holiday-season-part-2/

Structure:Data | GigaOM Events
http://event.gigaom.com/structuredata/

My Links
http://delicious.com/ajlopez/scalability

Keep tuned!

Angel “Java” Lopez
http://www.ajlopez.com
http://twitter.com/ajlopez

Scalability: Links, News And Resources (5)

Previous Post
Next Post

Twitter’s programmers speed Hadoop development | Big Data – InfoWorld
http://www.infoworld.com/d/big-data/twitters-programmers-speed-hadoop-development-211931

Twitter’s programmers speed Hadoop development | Big Data – InfoWorld
http://www.infoworld.com/d/big-data/twitters-programmers-speed-hadoop-development-211931?source=IFWNLE_nlt_stradev_2013-02-05

Cross-Post: Windows Azure SQL Database and SQL Server — Performance and Scalability Compared and Contrasted – Windows Azure – Site Home – MSDN Blogs
http://blogs.msdn.com/b/windowsazure/archive/2013/02/01/cross-post-windows-azure-sql-database-and-sql-server-performance-and-scalability-compared-and-contrasted.aspx

Building A Node.JS Server That Won’t Melt – A Node.JS Holiday Season, part 5 ✩ Mozilla Hacks – the Web developer blog
https://hacks.mozilla.org/2013/01/building-a-node-js-server-that-wont-melt-a-node-js-holiday-season-part-5/

Disk-Locality in Datacenter Computing Considered Irrelevant
http://www.cs.berkeley.edu/~ganesha/talks/disk-irrelevant.pdf

bitly/nsq
https://github.com/bitly/nsq
realtime distributed message processing at scale

High Scalability – High Scalability – Switch your databases to Flash storage. Now. Or you’re doing it wrong.
http://highscalability.com/blog/2012/12/10/switch-your-databases-to-flash-storage-now-or-youre-doing-it.html

Gangnam Ons S4 Recording on 2012-11-07 1410-Vimeo1 +6db on Vimeo
http://vimeo.com/53261709

4store – Scalable RDF storage
http://4store.org/

Amazon Redshift
http://aws.amazon.com/redshift/
petabyte-scale data warehouse service in the cloud

High Scalability – High Scalability – Gone Fishin’: Tumblr Architecture – 15 Billion Page Views A Month And Harder To Scale Than Twitter
http://highscalability.com/blog/2012/11/19/gone-fishin-tumblr-architecture-15-billion-page-views-a-mont.html?87125f76=t

Expanding the Cloud – Announcing Amazon Redshift, a Petabyte-scale Data Warehouse Service – All Things Distributed
http://www.allthingsdistributed.com/2012/11/amazon-redshift.html

High Scalability – High Scalability – BigData using Erlang, C and Lisp to Fight the Tsunami of Mobile Data
http://highscalability.com/blog/2012/11/26/bigdata-using-erlang-c-and-lisp-to-fight-the-tsunami-of-mobi.html

Facebook News Feed: Social Data at Scale
http://www.infoq.com/presentations/Facebook-News-Feed

SQLFire: Scalable SQL instead of NoSQL
http://www.infoq.com/presentations/SQLFire-Scalable-SQL-instead-of-NoSQL

How to Scale Your Start-up | Inc. 5000
http://www.inc.com/karl-and-bill/how-to-scale-your-start-up.html

When the Nerds Go Marching In – Alexis C. Madrigal – The Atlantic
http://www.theatlantic.com/technology/archive/2012/11/when-the-nerds-go-marching-in/265325/
How a dream team of engineers from Facebook, Twitter, and Google built the software that drove Barack Obama’s reelection

Scaling Software with Akka
http://www.infoq.com/presentations/Scalability-Akka

Erlang Scales … Do You?
http://www.infoq.com/presentations/Erlang-Scalability

RethinkDB: An open-source distributed database built with love over three years | Hacker News
http://news.ycombinator.com/item?id=4763879

Twitter survives election after Ruby-to-Java move • The Register
http://www.theregister.co.uk/2012/11/08/twitter_epic_traffic_saved_by_java/

Cases – Two Screen – Angry Bytes
http://two-screen.tv/cases/

Windows Azure’s Flat Network Storage and 2012 Scalability Targets – Windows Azure – Site Home – MSDN Blogs
http://blogs.msdn.com/b/windowsazure/archive/2012/11/02/windows-azure-s-flat-network-storage-and-2012-scalability-targets.aspx

The Startup Hangover: Supporting 15M Users
http://www.infoq.com/presentations/Scallability-SoundCloud

My Links
http://delicious.com/ajlopez/scalability

Keep tuned!

Angel “Java” Lopez
http://www.ajlopez.com
http://twitter.com/ajlopez

Scalability: Links, News And Resources (4)

Previous Post
Next Post

Scaling with MongoDB
http://www.slideshare.net/mongodb/scaling-4868170

Big Data @ Foursquare: Slides from our recent talk
http://engineering.foursquare.com/2011/03/24/big-data-foursquare-slides-from-our-recent-talk/

Fun with MongoDB replica sets
http://engineering.foursquare.com/2011/05/24/fun-with-mongodb-replica-sets/

Scaling Rails
http://railslab.newrelic.com/scaling-rails

Voldemort is a distributed key-value storage system
http://www.project-voldemort.com/voldemort/

USING HAPROXY FOR MYSQL FAILOVER AND REDUNDANCY
http://www.alexwilliams.ca/blog/2009/08/10/using-haproxy-for-mysql-failover-and-redundancy/

Amazon’s Dynamo
http://www.allthingsdistributed.com/2007/10/amazons_dynamo.html

Sharding & IDs at Instagram
http://instagram-engineering.tumblr.com/post/10853187575/sharding-ids-at-instagram

HAProxy
The Reliable, High Performance TCP/HTTP Load Balancer
http://haproxy.1wt.eu/

Ken Little on Scaling Tumblr
http://www.infoq.com/interviews/little-scaling-tumblr
Ken Little talks about scaling Tumblr to keep up with their blogging users: scaling the data model, sharding, their PHP frontend and the Scala backend, and much more.

The 4 Building Blocks Of Architecting Systems For Scale
http://highscalability.com/blog/2012/9/19/the-4-building-blocks-of-architecting-systems-for-scale.html

nsisodiya / Demo-Scalable-App
https://github.com/nsisodiya/Demo-Scalable-App/
This is small demo of Scalable JavaScript Application

Scaling to Millions of Simultaneous Connections: Rick Reed
http://vimeo.com/44312354

Drill
http://wiki.apache.org/incubator/DrillProposal
Drill is a distributed system for interactive analysis of large-scale datasets, inspired by Google’s Dremel.
NuoDB
http://www.nuodb.com/

An Easy Way to Build Scalable Network Programs
http://blog.nodejs.org/2011/10/04/an-easy-way-to-build-scalable-network-programs/

Memcached
http://memcached.org/

Redis Virtual Memory: the story and the code
http://oldblog.antirez.com/post/redis-virtual-memory-story.html

Improving Web Site Performance and Scalability While Saving Money
http://channel9.msdn.com/Events/aspConf/aspConf/Improving-Web-Site-Performance-and-Scalability-While-Saving-Money

Scalable JavaScript Design Patterns
http://www.slideshare.net/AddyOsmani/scalable-javascript-design-patterns

Cinchcast Architecture – Producing 1,500 Hours Of Audio Every Day
http://highscalability.com/blog/2012/7/16/cinchcast-architecture-producing-1500-hours-of-audio-every-d.html

The Netflix Simian Army
http://techblog.netflix.com/2011/07/netflix-simian-army.html

C Is For Compute – Google Compute Engine (GCE)
http://highscalability.com/blog/2012/7/2/c-is-for-compute-google-compute-engine-gce.html

My Links
http://delicious.com/ajlopez/scalability

Keep tuned!

Angel “Java” Lopez
http://www.ajlopez.com
http://twitter.com/ajlopez

Scalability: Links, News And Resources (3)

Previous Post
Next Post

The C10K problem
http://www.kegel.com/c10k.html
It’s time for web servers to handle ten thousand clients simultaneously

The Underlying Technology of Messages at Facebook
https://www.facebook.com/notes/facebook-engineering/the-underlying-technology-of-messages/454991608919

Memcached
http://memcached.org/
Free & open source, high-performance, distributed memory object caching system

An Easy Way to Build Scalable Network Programs
http://blog.nodejs.org/2011/10/04/an-easy-way-to-build-scalable-network-programs/

NuoDB
http://www.nuodb.com/

How to beat the CAP theorem
http://nathanmarz.com/blog/how-to-beat-the-cap-theorem.html
The CAP theorem states a database cannot guarantee consistency, availability, and partition-tolerance at the same time.

The LMAX Architecture
http://martinfowler.com/articles/lmax.html
LMAX is a new retail financial trading platform. As a result it has to process many trades with low latency. The system is built on the JVM platform and centers on a Business Logic Processor that can handle 6 million orders per second on a single thread.

Redis Virtual Memory: the story and the code
http://antirez.com/post/redis-virtual-memory-story.html

Improving Web Site Performance and Scalability While Saving Money
http://channel9.msdn.com/Events/aspConf/aspConf/Improving-Web-Site-Performance-and-Scalability-While-Saving-Money
Scalable JavaScript Design Patterns
http://www.slideshare.net/AddyOsmani/scalable-javascript-design-patterns

Cinchcast Architecture – Producing 1,500 Hours Of Audio Every Day
http://highscalability.com/blog/2012/7/16/cinchcast-architecture-producing-1500-hours-of-audio-every-d.html

The Netflix Simian Army
http://techblog.netflix.com/2011/07/netflix-simian-army.html

C Is For Compute – Google Compute Engine (GCE)
http://highscalability.com/blog/2012/7/2/c-is-for-compute-google-compute-engine-gce.html

How we got rid of the database
http://lostechies.com/gabrielschenker/2012/06/20/how-we-got-rid-of-the-databasepart-4/

Improving performance on twitter.com
http://engineering.twitter.com/2012/05/improving-performance-on-twittercom.html

Against the Grain: How We Built the Next Generation Online Travel Agency using Amazon, Clojure, and a Comically Small Team
http://www.colinsteele.org/post/23103789647/against-the-grain-aws-clojure-startup

Building a Website To Scale
http://www.youtube.com/watch?v=RlkCdM_f3p4&feature=g-all-u

Vert.x vs node.js simple HTTP benchmarks
http://vertxproject.wordpress.com/2012/05/09/vert-x-vs-node-js-simple-http-benchmarks/

vert.x
http://vertx.io/
Effortless asynchronous application development for the modern web and enterprise

Introducing Resque
https://github.com/blog/542-introducing-resque
Resque is our Redis-backed library for creating background jobs, placing those jobs on multiple queues, and processing them later.

How to take advantage of Redis just adding it to your stack
http://antirez.com/post/take-advantage-of-redis-adding-it-to-your-stack.html

PubSub with Redis and Akka Actors
http://debasishg.blogspot.com.ar/2010/04/pubsub-with-redis-and-akka-actors.html

MagLev
http://maglev.github.com/
The MagLev VM takes full advantage of GemStone/S JIT to native code performance, distributed shared cache, fully ACID transactions, and enterprise class NoSQL data management capabilities to provide a robust and durable programming platform.

My Links
http://delicious.com/ajlopez/scalability

Keep tuned!

Angel “Java” Lopez
http://www.ajlopez.com
http://twitter.com/ajlopez

Scalability: Links, News And Resources (2)

Previous Post
Next Post

Programming and Scaling
https://www.tele-task.de/archive/lecture/overview/5819/

Spain Scalability Group
https://sites.google.com/site/spainscalabilitygroup/

The Instagram Architecture Facebook Bought For A Cool Billion Dollars
http://highscalability.com/blog/2012/4/9/the-instagram-architecture-facebook-bought-for-a-cool-billio.html

Just how big are porn sites?
http://www.extremetech.com/computing/123929-just-how-big-are-porn-sites

Scalability at YouTube
http://www.youtube.com/watch?v=G-lGCC4KKok

7 Years Of YouTube Scalability Lessons In 30 Minutes
http://highscalability.com/blog/2012/3/26/7-years-of-youtube-scalability-lessons-in-30-minutes.html

NoSQL Data Modeling Techniques
http://highlyscalable.wordpress.com/2012/03/01/nosql-data-modeling-techniques/

Akka 2.0: Scalability of Fork Join Pool
http://letitcrash.com/post/17607272336/scalability-of-fork-join-pool

Scaling Erlang
http://inaka.net/blog/2011/10/07/scale-test-plan-simple-erlang-application/

Tumblr Architecture – 15 Billion Page Views A Month And Harder To Scale Than Twitter
http://highscalability.com/blog/2012/2/13/tumblr-architecture-15-billion-page-views-a-month-and-harder.html

How Facebook pushes new code live
http://agilewarrior.wordpress.com/2011/05/28/how-facebook-pushes-new-code-live/

Can Simplicity Scale?
http://blog.regehr.org/archives/663

Amazon DynamoDB – a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications
http://www.allthingsdistributed.com/2012/01/amazon-dynamodb.html

Implementing Scalable HA Architectures with Spring Integration
http://www.infoq.com/presentations/Implementing-HA-Architectures-Spring-Integration

Arquitectura de un buscador vertical escalable con Hadoop
http://www.datasalt.es/2011/10/arquitectura-de-un-buscador-vertical-escalable-con-hadoop/

What is Zing? A Scalable, Elastic, High-Performance Java Virtual Machine (JVM)
http://www.azulsystems.com/products/zing/whatisit

Azul Making Java “Zing”
http://java.dzone.com/articles/azul-making-java-zing

Autoscaling with Enterprise Library Integration Pack for Windows Azure
http://blogs.msdn.com/b/jdom/archive/2011/12/02/autoscaling-with-enterprise-library-integration-pack-for-windows-azure.aspx

DataSift Using MySQL, HBase, Memcached to Deal With Twitter Firehose
http://nosql.mypopescu.com/post/13540746376/datasift-using-mysql-hbase-memcached-to-deal-with

DataSift Architecture: Realtime Datamining At 120,000 Tweets Per Second
http://highscalability.com/blog/2011/11/29/datasift-architecture-realtime-datamining-at-120000-tweets-p.html

Scaling at Gowalla: Databases & NoSQL
http://engineering.gowalla.com/2011/11/17/scaling-and-gowalla/

Microsoft drops Dryad; puts its big-data bets on Hadoop
http://www.zdnet.com/blog/microsoft/microsoft-drops-dryad-puts-its-big-data-bets-on-hadoop/11226

How StackOverflow Scales with SQL Server (Video)
http://www.brentozar.com/archive/2011/11/how-stackoverflow-scales-sql-server-video/

Scaling Isomorphic Javascript Code
http://blog.nodejitsu.com/scaling-isomorphic-javascript-code
Javascript is now an isomorphic language. By isomorphic we mean that any given line of code (with notable exceptions) can execute both on the client and the server.

One million!
http://blog.whatsapp.com/index.php/2011/09/one-million/

Building Scalable Systems: an Asynchronous Approach
http://www.infoq.com/presentations/Building-Scalable-Systems-Asynchronous-Approach

jdegoes / blueeyes
https://github.com/jdegoes/blueeyes
A lightweight Web 3.0 framework for Scala, featuring a purely asynchronous architecture, extremely high-performance, massive scalability, high usability, and a functional, composable design.

NOSQL Patterns
http://cloud.dzone.com/news/nosql-patterns

Wikimedia Architecture
http://highscalability.com/wikimedia-architecture

Stuff The Internet Says On Scalability For August 5, 2011
http://highscalability.com/blog/2011/8/5/stuff-the-internet-says-on-scalability-for-august-5-2011.html

Keep tuned!

My Links
http://delicious.com/ajlopez/scalability

CQRS: Links, News And Resources (6)

Previous Post

Lokad.CQRS Event Store is Slow – Journal – CQRS and Cloud Computing
http://abdullin.com/journal/2013/1/21/lokadcqrs-event-store-is-slow.html

CQRS: Command/Query Responsibility Segregation
http://www.slideshare.net/brianritchie1/cqrs-command-query-responsibility-segregation

Basic tutorial on Event Sourcing and CQRS « Code Snippets
http://mriet.wordpress.com/2012/09/22/basic-tutorial-on-event-sourcing-and-cqrs/

CQRS Architecture and Definitions – Journal – CQRS and Cloud Computing
http://abdullin.com/journal/2010/11/3/cqrs-architecture-and-definitions.html

CQRS Info
http://www.cqrsinfo.com/

CQRS-FAQ – home
http://cqrs-faq.wikispaces.com/

Using commands · sharparchitecture/Sharp-Architecture-Cookbook Wiki
https://github.com/sharparchitecture/Sharp-Architecture-Cookbook/wiki/Using-commands

gregoryyoung/m-r · GitHub
https://github.com/gregoryyoung/m-r
CQRS Example

ToJans/mauritius · GitHub
https://github.com/ToJans/mauritius
CQRS Example

mem-memov/blackboard · GitHub
https://github.com/mem-memov/blackboard/
Online blackboard

Doodle: VAN: CQRS Journey
http://www.doodle.com/b6keemn8xw93qrff

CQRS Journey
http://msdn.microsoft.com/en-us/library/jj554200.aspx

Event Store – An awesome, rock-solid, super-fast persistence engine for event-sourced applications
http://geteventstore.com/

DDD\CQRS Sample
http://cqrssample.codeplex.com/

Aggregate Root holding reference to another Aggregate, how do i set up the dependencies ? – Google Groups
https://groups.google.com/forum/#!topic/dddcqrs/TQBTn-tIj-w/discussion

My Links
http://delicious.com/ajlopez/cqrs

Keep tuned!

Angel “Java” Lopez
http://www.ajlopez.com
http://twitter.com/ajlopez