Managing continuous applications Track

Testing Stateful Streaming Applications

As more workloads migrate from batch to stream processing there is ever increasing demand on streaming applications to operate based on more complex business rules. Apache Flink provides many high and low level api’s for writing a wide breadth of stateful streaming applications. However, as applications get more complex they can become harder to understand and debug. This talk will discuss best practices for writing well tested streaming applications with an eye towards working with stateful operators and validating against failure. We will do this by walking through the world’s most thoroughly tested implementation of word count.

Authors

Seth Wiesman
Data Engineer MediaMath
Seth Wiesman

Seth Wiesman is a Data Engineer on the reporting team at MediaMath, where he works on real-time distributed systems and Big Data technologies to provide analytics and insights to the users of T1.

Fill out the form to view
the Slides and Video

* All fields required