FLaNK: Low Code Streaming: Populating Kafka Topics with FlinkSQL Joins in Real-Time
Then I can create my 3 tables. Two are the source ones to join and the third is the destination for my insert.
INSERT INTO global_sensor_events
SELECT
scada.uuid,
scada.systemtime ,
scada.temperaturef ,
scada.pressure ,
scada.humidity ,
scada.lux ,
scada.proximity ,
scada.oxidising ,
scada.reducing ,
scada.nh3 ,
scada.gasko,
energy.current
,
energy.voltage ,
energy.power
,
energy.total
,
energy.fanstatus
FROM energy,
scada
WHERE
scada.systemtime = energy.systemtime;
Examples
https://github.com/tspannhw/meetup-sensors/blob/master/flink-sql/
Assets / Scripts / DDL / SQL
https://github.com/tspannhw/FlinkSQLDemo
Flink Guide to SQL Joins
https://www.youtube.com/watch?v=5AuBlVRKQuo
Slides
https://www.slideshare.net/bunkertor/time-series-analysis-dataflow
Article on Joins
https://www.datainmotion.dev/2020/05/flink-sql-preview.html
Resources
- https://github.com/cloudera/flink-tutorials
- https://docs.cloudera.com/csa/1.1.0/job-lifecycle/topics/csa-run-job.html
- https://github.com/asdaraujo/edge2ai-workshop/tree/master/flink
- https://ci.apache.org/projects/flink/flink-docs-stable/dev/table/sqlClient.html
- https://ci.apache.org/projects/flink/flink-docs-release-1.10/dev/table/sqlClient.html