The data Artisans Blog
Apache Flink, stream processing, event-driven applications, and more.
Category: Apache Flink
Stream processing: An Introduction to Event Time in Apache FlinkNovember 16, 2018
Apache Flink supports multiple notions of time for stateful stream processing. This post focuses on event time support in Apache Flink. In the following sections we define what event time is with Apac...
Years in Big Data. Months with Apache Flink. 5 Early Observations With Stream ProcessingNovember 14, 2018
This Fall I became more active with the Apache Flink community in my role as Technical Evangelist at data Artisans, after almost 8 years in Big Data. At October’s Bay Area Flink Meetup, I discussed ...
Broadcast State Pattern in Apache Flink: 4 important considerationsNovember 9, 2018
This episode of Flink Friday Tip explores the Broadcast State pattern that was introduced in Apache Flink 1.5.0. In the following sections, we describe what is a Broadcast State Pattern, how Broadca...
Flink SQL for powerful querying of data streams and data at restNovember 6, 2018
While Flink SQL was initially released with Flink 1.1.0 back in August 2016 recent Flink releases have added quite a bit of functionality that makes Flink SQL easier to use by eliminating the need to ...
3 differences between Savepoints and Checkpoints in Apache FlinkNovember 2, 2018
This episode of our Flink Friday Tip explains what Savepoints and Checkpoints are and examines the main differences between them in Apache Flink. In the following paragraphs, we explain what Savepoint...
Stateful Stream Processing: Apache Flink State BackendsOctober 26, 2018
This episode of our Flink Friday Tip explores stateful stream processing and more precisely the different state backends available in Apache Flink. In the following sections, we present the 3 state ba...
Community Update: October 2018 Apache Flink Bay Area MeetupOctober 22, 2018
On October 11 MapR and data Artisans held their first mutual Apache Flink Meetup in the Bay Area with more than 40 attendees. The Flink community enjoyed a packed agenda with detailed talks and time f...
Watermarks in Apache Flink Made EasyOctober 19, 2018
As folks first begin to work with Flink, watermarks can be a source of confusion. But this topic doesn’t have to be complicated. Let’s work through a simple example that will show why we need wate...
How Apache Flink manages Kafka consumer offsetsOctober 12, 2018
In this episode of our Flink Friday Tip, we explain with a step-by-step example how Apache Flink works with Apache Kafka to ensure that records from Kafka topics are processed with exactly-once guaran...