Timothy Spann. 🇺🇦
Learning Apache Flink 1.9
Everything is a Stream, important concept to remember when working with Apache Flink.
Submit a Job
https://ci.apache.org/projects/flink/flink-docs-stable/ops/cli.html
p.p1 {margin: 0.0px 0.0px 0.0px 0.0px; font: 18.0px Menlo; color: #ffffff; background-color: #224fbc} span.s1 {font-variant-ligatures: no-common-ligatures}
flink run -m yarn-cluster -d -p 2 -ynm Wiki iot-1.0.jar
Mm Flank
I am working on a nice integration pattern with the Mm Flank Stack of Apache NiFi-MiniFi, MXNet, Flink, NiFi, Kafka and Kudu.
Flink Monitoring
http://princeton0.field.hortonworks.com:8082/config
{"refresh-interval":10000,"timezone-offset":0,"timezone-name":"Coordinated Universal Time","flink-version":"1.9.0-csa1.0.0.0","flink-revision":"3cedceb @ 04.11.2019 @ 13:38:10 UTC"}
http://princeton0.field.hortonworks.com:8082/jobs/overview
--cluster=true
flink run -m yarn-cluster -d -p 2 -yD log4j.configuration.file=log4j.properties -ynm IoT iot-1.0.jar --cluster true
flink run -m yarn-cluster -d -p 2 -ynm Wiki iot-1.0.jar
p.p1 {margin: 0.0px 0.0px 0.0px 0.0px; font: 18.0px Menlo; color: #ffffff; background-color: #224fbc} span.s1 {font-variant-ligatures: no-common-ligatures}
flink run -m yarn-cluster /opt/cloudera/parcels/FLINK/lib/flink/examples/streaming/WordCount.jar --input hdfs:///tmp/README.txt --output hdfs:///tmp/ReadMe-Counts
References
- https://github.com/cloudera/flink-tutorials/tree/master/flink-secure-tutorial
- https://github.com/cloudera/flink-tutorials/tree/master/flink-simple-tutorial
- https://www.cloudera.com/content/dam/www/marketing/documents/products/csa-beta-v1.0.pdf
- https://github.com/apache/flink/tree/master/flink-examples/flink-examples-streaming/src/main/java/org/apache/flink/streaming/examples
- https://www.slideshare.net/FlinkForward/flinkdtw-timeseries-pattern-search-at-scale-using-dynamic-time-warping-christophe-salperwyck-akamai-technologies
- https://github.com/tspannhw/MmFLaNK
- https://ci.apache.org/projects/flink/flink-docs-stable/monitoring/rest_api.html
- https://github.com/tspannhw/flink-examples
- https://www.baeldung.com/kafka-flink-data-pipeline
- https://ci.apache.org/projects/flink/flink-docs-stable/
- https://www.datacouncil.ai/hubfs/Data%20Council/slides/bcn19/Stream%20Proc%20Beyond%20Streaming%20Data.pdf
- https://acadgild.com/blog/what-is-apache-flink-how-to-install-flink-a-beginners-guide
- https://www.kdnuggets.com/2016/10/beginners-guide-apache-flink-explained.html
- https://data-flair.training/blogs/apache-flink-tutorial/
- https://ci.apache.org/projects/flink/flink-docs-release-1.9/monitoring/metrics.html
- https://ci.apache.org/projects/flink/flink-docs-stable/dev/connectors/kafka.html
- https://www.ververica.com/blog/kafka-flink-a-practical-how-to
- https://github.com/apache/flink/blob/master/flink-connectors/flink-hbase/src/test/java/org/apache/flink/addons/hbase/example/HBaseWriteStreamExample.java
- https://ci.apache.org/projects/flink/flink-docs-release-1.9/dev/datastream_api.html#data-sources
- https://ci.apache.org/projects/flink/flink-docs-release-1.9/dev/connectors/rabbitmq.html
- https://bahir.apache.org/downloads/flink/
- https://training.ververica.com/intro/rideCleansing.html
- https://github.com/ververica/flink-training-exercises/blob/master/src/main/java/com/ververica/flinktraining/solutions/datastream_java/basics/RideCleansingSolution.java
