⌨️ Pipe xlsx files into/from Kafka... From cli with (k)cat πŸ™€

adriens - Oct 10 '22 - - Dev Community

πŸͺ Teaser

What you'll discover in this post is how we could, within a dedicated KillerCoda scenario :

  • Literally pipe data to and from Kafka, from (and to) any file, with the | operator
  • Visualize data on a cool web interface on Redpanda Console

πŸ’ on the 🍰

We'll play with real life data from isee.nc :

Image description

☝️ Now... to fully enjoy this post, please be sure to really

πŸ‘‰ deeply understand what pipe is, how and why it was created... and all the amazing opportunities it opened since its early ages.

πŸͺ„ Intro : Unix Pipeline πŸ¦Έβ€β™‚οΈ

Spend 5' to deeply understand how and why the | was created and why it still matters (a lot) today.

🧰 Tools (and Philosophy) 🏺

Now, you can jump start in the demo where we'll do everything from the terminal thanks to all these amazing, UNIX Philosophic single-purposed tools :

🍿 Full demo

πŸ”– Resources

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .