Explore Enterprise Apache Flink with Cloudera Streaming Analytics - CSA 1.2

Timothy Spann. 🇺🇦 - Jun 29 '20 - - Dev Community



Explore Enterprise Apache Flink with Cloudera Streaming Analytics - CSA 1.2

What's New in Cloudera Streaming Analytics

https://docs.cloudera.com/csa/1.2.0/release-notes/topics/csa-what-new.html

https://docs.cloudera.com/csa/1.2.0/index.html

Try out the tutorials now: https://github.com/cloudera/flink-tutorials

So let's get our Apache Flink on, as part of my FLaNK Stack series I'll show you some fun things we can do with Apache Flink + Apache Kafka + Apache NiFi.

We will look at some of updates in Apache Flink 1.10 including the SQL Client and API.

We are working with Apache Flink 1.10, Apache NiFi 1.11.4 and Apache Kafka 2.4.1.

The SQL features are strong and we will take a look at what we can do.

https://docs.cloudera.com/csa/1.2.0/release-notes/topics/csa-supported-sql.html

Table connectors

  • Kafka
  • Kudu
  • Hive (through catalog)

Data formats (Kafka)

  • JSON
  • Avro
  • CSV

Using Hive Catalog with Flink SQL: https://docs.cloudera.com/csa/1.2.0/flink-sql-table-api/topics/csa-hive-catalog.html

Use Kudu Catalog with Flink SQL: https://docs.cloudera.com/csa/1.2.0/flink-sql-table-api/topics/csa-kudu-catalog.html

Building a DataStream Application in Flink

https://docs.cloudera.com/csa/1.2.0/flink-sql-table-api/topics/csa-sql-table-api.html

Build A Flink Project

mvn archetype:generate \ -DarchetypeGroupId=org.apache.flink \ -DarchetypeArtifactId=flink-quickstart-java \ -DarchetypeVersion=1.10.0
Enter fullscreen mode Exit fullscreen mode

References :

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .