The data Artisans Blog
Apache Flink, stream processing, event-driven applications, and more.
An Overview of End-to-End Exactly-Once Processing in Apache Flink® (with Apache Kafka, too!)February 15, 2018
This post is an adaptation of Piotr Nowojski’s presentation from Flink Forward Berlin 2017. You can find the slides and a recording of the presentation on the Flink Forward Berlin website.Apache Fli...
Managing Large State in Apache Flink®: An Intro to Incremental CheckpointingJanuary 23, 2018
Apache Flink was purpose-built for stateful stream processing. Let’s quickly review: what is state in a stream processing application? I defined state and stateful stream processing in a previous bl...
How To Size Your Apache Flink® Cluster: A Back-of-the-Envelope CalculationJanuary 11, 2018
A favorite session from Flink Forward Berlin 2017 was Robert Metzger’s “Keep It Going: How to Reliably and Efficiently Operate Apache Flink”. One of the topics that Robert touches on is how to ...
On Designing a Stream Processing BenchmarkJuly 27, 2017
Update December 18, 2017: We wrote a follow-up blog post about stream processing benchmarks that goes into more detail about the issues we see with common benchmarking methods. It serves as a useful a...
Complex Event Generation for Business Process Monitoring using Apache Flink®July 13, 2017
This is a guest post by Hung Chang & Mihail Vieru of Zalando. It originally appeared on the Zalando Technology Blog and was reposted here with permission. While developing Zalando’s real-time busi...
Dynamically Configured Stream Processing: How BetterCloud Built an Alerting System with Apache Flink®June 29, 2017
Many Apache Flink® users are building applications for alerting or anomaly detection, and ING and Mux are two such examples from the most recent Flink Forward conference. Today, we’ll highlight the...
data Artisans – Mesosphere Webinar + Live Q&A: April 25 at 10am Pacific TimeMarch 29, 2017
Jamie Grier, data Artisans’ Director of Applications Engineering, will co-host a webinar with members of the Mesosphere team on April 25, 2017, at 10am Pacific Time. You can register here. We hope y...
Queryable State in Apache Flink® 1.2.0: An Overview & DemoMarch 24, 2017
Ufuk Celebi (@iamuce) is a co-founder and software engineer at data Artisans. 2016 was the year that stateful, event-time, and event-at-a-time stream processing arrived as the paradigm for high-thro...
Drivetribe’s Modern Take On CQRS With Apache Flink®March 9, 2017
This is a guest post from Aris Koliopoulos, a senior software engineer at London-based Drivetribe. Drivetribe is the world’s digital hub for motoring. The platform was created by former Top Gear pre...