Creating operational insights using Apache Flink

Amazon Kinesis Data Analytics for Apache Flink allows us to go beyond SQL and use Java or Scala as programming languages and a data stream API to build our analytics applications. In this section, we are going to focus on KDA for Flink.

Note

If you are not familiar with Apache Flink, we recommend you first go through the Flink overview: https://ci.apache.org/projects/flink/flink-docs-release-1.11/learn-flink/.

Apache Flink deserves a book in itself, and we are going to cover how to run Flink applications on KDA specifically.

When we create applications with KDA for Flink, we follow the same pattern as we did with KDA SQL, with a number of differences outlined in the following table:

Figure 6.9 – KDA SQL and KDA Flink comparison

KDA Flink applications come with more options and flexibility, which can be a determining factor in selecting which engine to use. For example, it is common for companies...