Upcoming Apache Pulsar and Apache Flink Talks - ApacheCon Asia and ApacheCon 2021

Timothy Spann. 🇺🇦 - Sep 2 '21 - - Dev Community

ApacheCon Asia 2021

#messaging

#streaming

- 2021-08-07 16:10 GMT+8 - EVOLUTION AND TYPICAL SCENES OF FLINK-BASED REAL TIME COMPUTING PLATFORM IN QIHOO 360 by FAN XINPU ( CHINESE SESSION)

StreamNative - David Kjerrumgaard's Talk

REAL-TIME MACHINE LEARNING WITH PULSAR FUNCTIONS

ENGLISH SESSION 2021-08-08 15:30 GMT+8

In this talk I will present a technique for deploying machine learning models to provide real-time predictions using Apache Pulsar Functions. In order to provide a prediction in real-time, the model usually receives a single data point from the caller, and is expected to provide an accurate prediction within a few milliseconds.

Throughout this talk, I will demonstrate the steps required to productionize a fully-trained ML that predicts the delivery time for a food delivery service based upon real-time traffic information, the customer;s location, and the restaurant that will be fulfilling the order.

Speaker:

David Kjerrumgaard: David is the author of “Pulsar in Action”

StreamNative - Tim Spann's Talk

FLANK STACK WITH FLINK FOR STREAMING USE CASES

ENGLISH SESSION 2021-08-08 14:50 GMT+8

oday, data is being generated from devices and containers living at the edge of networks, clouds and data centers. We need to run business logic, analytics and deep learning at the edge before we start our real-time streaming flows. Fortunately using the all FLiP & FLaNK stacks we can do this with ease! Streaming AI Powered Analytics From the Edge to the Data Center is now a simple use case. With MiNiFi we can ingest the data, do data checks, cleansing, run machine learning and deep learning models and route our data in real-time to Apache NiFi and Apache Pulsar for further transformations and processing. Apache Flink will provide our advanced streaming capabilities fed real-time via Apache Pulsar topics. Apache MXNet models will run both at the edge and in our data centers via Apache NiFi and MiNiFi.

Tools: Apache Flink, Apache Pulsar, Apache NiFi, MiNiFi, Apache MXNet

Speaker:

Timothy Spann: Tim Spann is a Developer Advocate at StreamNative where he works with Apache NiFi, MiniFi, Kafka, Apache Flink, Apache MXNet, TensorFlow, Apache Spark, big data, the IoT, machine learning, and deep learning. Tim has over a decade of experience with the IoT, big data, distributed computing, streaming technologies, and Java programming. Previously, he was a senior solutions architect at AirisData and a senior field engineer at Pivotal. He blogs for DZone, where he is the Big Data Zone leader, and runs a popular meetup in Princeton on big data, the IoT, deep learning, streaming, NiFi, the blockchain, and Spark. Tim is a frequent speaker at conferences such as IoT Fusion, Strata, ApacheCon, Data Works Summit Berlin, DataWorks Summit Sydney, and Oracle Code NYC. He holds a BS and MS in computer science.

https://www.datainmotion.dev/p/about-me.html

https://dzone.com/users/297029/bunkertor.html https://dev.to/tspannhw

ApacheCon Global 2021

StreamNative Talks

Tuesday 14:10 UTC

Exclusive Producer: Using Apache Pulsar to build distributed applications

Matteo Merli

Wednesday 15:50 UTC

Replicated Subscriptions: taking Apache Pulsar Geo-Replication to next level

Matteo Merli

Tuesday 17:10 UTC - Apache NIFi Deep Dive 300 - Tim Spann

Tuesday 18:00 UTC - Apache Deep Learning 302 ** - Tim Spann**

Wednesday 15:00 UTC - Smart Transit: Real-Time Transit Information with FLaNK** - Tim Spann **** **

Wednesday 17:10 UTC - Cracking the Nut, Solving Edge AI with Apache Tools and Frameworks ** - Tim Spann**

Thursday 14:10 UTC - Apache NiFi 101: Introduction and Best Practices - Tim Spann

Apache Flink and Apache Pulsar

  • Tuesday 15:00 UTC Building resilient and scalable API backends with Apache Pulsar and Spring Reactive Lari Hotari
  • Wednesday 14:10 UTC Apache Flink StateFun: A Platform-Independent Stateful Serverless Stack Tzu-Li (Gordon) Tai
  • Wednesday 17:10 UTC Pulsar Beam, HTTP streaming over Apache Pulsar Ming Luo
  • Tuesday 15:00 UTC Getting Started with Event Stream Processing via Apache Flink on Microsoft Azure Israel Ekpo
  • Tuesday 15:50 UTC Great Expectations: Data Lake as a Source to Apache Flink to Better Support Machine Learning Use Cases Sofya Irwin, Charles Tan
  • Wednesday 14:10 UTC Architectures and Trends for Event Stream Processing on Azure with Open Source Software Israel Ekpo

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .