Finagle (Twitter's Apache-licensed RPC stack) and Apache Mesos are two core technologies used by ...
Finagle (Twitter's Apache-licensed RPC stack) and Apache Mesos are two core technologies used by Twitter to scale its multi-service architecture to high-volume traffic loads. In this talk, we describe how Twitter used Finagle and Mesos together to address the challenges of scaling its application. We introduce linkerd, an Apache-licensed proxy form of Finagle, which extends Finagle's operational model to non-JVM or polyglot multi-service applications. Finally, we show how linkerd can be used to "wrap" applications running in Apache Mesos to provide higher-level, service-based semantics around scalability, reliability, and fault-tolerance for multi-service or microservice applications---even in the presence of high traffic loads and unreliable hardware.