Apache Mesos for Big Data and More
Confreaks' great collection of 2012 Airbnb Tech Talks includes this talk on Apache Mesos from Ben Hindman:
This talk will be about Apache Mesos, a platform that provides efficient resource isolation and sharing for distributed applications and frameworks. You can use Mesos to run Hadoop, MPI, Hypertable, Spark (a new framework for low-latency interactive and iterative jobs), and others on the same cluster. You can also use Mesos to help build novel distributed applications and frameworks. In this talk I'll discuss the architecture and motivation of Mesos, describe how to build a new application/framework on Mesos, and how Mesos is currently being used at Twitter and other places.