Ecosystem Track

Operating Flink on Mesos at Scale

Flink has supported Apache Mesos officially since the 1.2 release and many users have been using them together even before that. The latest releases 1.4 and 1.5 (not released at the time of writing) add a deeper integration for resource schedulers, such as Mesos, which also resulted in many new features around this integration. But what does that mean in practice for operating large cluster? In this talk, we will discuss operational best practices-alongside with some pitfalls- for operating large Flink cluster on top of Apache Mesos, including topics such as: * Deployments, * Monitoring, * Scaling, * Upgrades, * Debugging.

Authors

Jörg Schad
Jörg Schad
Technical Lead Community Projects Mesosphere
Jörg Schad

Jörg is a Technical Lead for Community Projects at Mesosphere in Hamburg. In his previous life he implemented distributed and in memory databases and conducted research in the Hadoop and Cloud area. His speaking experience includes various Meetups, international conferences, and lecture halls.

Biswajit Das
Biswajit Das
Chief Architect and Engineering Manager Branch
Biswajit Das

Biswajit is the Chief Architect and Engineering Manager @ Branch, where he focuses on data infrastructure and platform scalability. His area of expertise is in real-time data processing systems and multi-tenant scale-out elastic cloud systems. He led the design and development of a petabyte scale sub-second latency analytics platform at Branch

Fill out the form to view
the Slides and Video

* All fields required