Timothy Spann. 🇺🇦20-June-2023
FLiPN-FLaNK Stack Weekly
Tim Spann @PaaSDev
We are publishing late due to Father's Day and https://en.wikipedia.org/wiki/Juneteenth.
NiFI updates
Apache NiFi 1.22 is now available for download!
Release Date: June 11, 2023
MiNiFi agents can now talk to C2 servers using reverse proxy/load balancers.
New processor to support modifying the compression algorithm of content which still incurs the CPU hit substantially improves IO by avoiding writing and reading the intermediary decompressed form.
New processor for Azure Queue Storage using Azure SDK 12.
Put Database Record now allows for Upserts.
Deprecated additional components and features in preparation toward an Apache NiFi 2.0.
Upgraded numerous dependencies due to potential vulnerabilities and latest stable lines.
Numerous bug fixes to processors but also core NiFi framework behavior
A full list of issues that were resolved can be found at:
https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12316020&version=12353069
https://cwiki.apache.org/confluence/display/NIFI/Deprecated+Components+and+Features
CODE + COMMUNITY
Please join my meetup group NJ/NYC/Philly/Virtual.
http://www.meetup.com/futureofdata-princeton/
https://www.meetup.com/futureofdata-newyork/
https://www.meetup.com/futureofdata-philadelphia/
*This is Issue #90 *
You may notice a version jump, Linked in says we had 89 already, so I am assuming two other articles got assimilated. I will go with this, since 90 is a better number.
https://github.com/tspannhw/FLiPStackWeekly
https://www.linkedin.com/pulse/schedule-2023-tim-spann-/
Videos
https://www.youtube.com/watch?v=_uYp8s6_6GA&t=1s&pp=ygUQIlRpbSBzcGFubiIgbmlmaQ%3D%3D
https://www.cloudera.com/about/events/cloudera-now-cdp.html
Articles
https://dzone.com/articles/harnessing-the-power-of-nifi-building-a-seamless-f
https://medium.com/@tspann/apache-nifi-1-22-updates-e658eaff3308
https://blog.cloudera.com/one-big-cluster-stuck-platform-health/
https://medium.com/@ayushtkn/apache-hive-esri-geospatial-support-5ca815daaa7e
https://medium.com/@kiranprabhu/kafka-topic-naming-conventions-best-practices-6b6b332769a3
https://www.datanami.com/2023/01/30/five-drivers-behind-the-rapid-rise-of-apache-flink/
https://webtechie.be/post/2023-06-15-crac-on-raspberry-pi/
https://www.cdc.gov/nbs/modernization/stories/202304.html
https://www.smarthomebeginner.com/podman-vs-docker/
https://speakerdeck.com/stevenz3wu/streaming-from-apache-iceberg-qcon-ny-2023?slide=8
https://thenewstack.io/kelsey-hightower-predicts-how-the-kubernetes-community-will-evolve/
Recent Talks
https://www.youtube.com/watch?v=Ws7YmAHE1O8
https://www.cloudera.com/about/events/evolve.html
https://speakerdeck.com/stevenz3wu/streaming-from-apache-iceberg-qcon-ny-2023
Events
June 26-28, 2023: NLIT Summit. Milwaukee.
https://www.fbcinc.com/e/nlit/default.aspx
June 28, 2023: NiFi Meetup. Milwaukee and Hybrid.
https://www.meetup.com/futureofdata-princeton/events/292976004/
July 19, 2023: 2-Hours to Data Innovation: Data Flow
https://www.cloudera.com/about/events/hands-on-lab-series-2-hours-to-data-innovation.html
October 18, 2023: 2-Hours to Data Innovation: Data Flow
https://www.cloudera.com/about/events/hands-on-lab-series-2-hours-to-data-innovation.html
Cloudera Events
https://www.cloudera.com/about/events.html
More Events:
https://www.linkedin.com/pulse/schedule-2023-tim-spann-/
LLM Generated Code
Code
- https://github.com/tspannhw/FLaNK-ParticulateMatterSensor
- https://hub.docker.com/r/apache/hive
- https://impala.apache.org/docs/build/html/topics/impala_iceberg.html
NiFi Code
- https://github.com/tspannhw/FLaNK-CDC/blob/main/flinkcdc.MD
- https://github.com/tspannhw/FLaNK-CDC/blob/main/kafkacdc.md
- https://mvnrepository.com/artifact/org.apache.nifi/nifi-media-nar/1.22.0
- https://github.com/tspannhw/FLaNK-NARs
- https://github.com/tspannhw/FLaNK-Edge
- https://github.com/tspannhw/FLaNK-ParticulateMatterSensor
- https://github.com/tspannhw/FLaNK-LLM
Tools
- https://github.com/stanfordroboticsclub/StanfordQuadruped
- https://www.newsletter.swirlai.com/p/sai-notes-03-apache-flink-architecture
- https://github.com/AI4Finance-Foundation/FinGPT
- https://github.com/jedisct1/libsodium
- https://waabi.ai/oyster/
- https://www.baeldung.com/gatling-load-testing-rest-endpoint
- https://github.com/alibaba/fastjson2
- https://federatedscope.io/docs/algozoo/
- https://designable-antd.formilyjs.org/
- ChatGPT Mac/Windows App for SQL https://github.com/alibaba/Chat2DB
- https://github.com/alibaba/arthas
- Recommendation Framework https://github.com/alibaba/EasyRec
- All in One Computer Vision https://github.com/alibaba/EasyCV
- https://github.com/alibaba/EasyCV/blob/master/docs/source/tutorials/cls.md
- Model as a Service https://github.com/modelscope/modelscope
- CDC from MySQL https://github.com/alibaba/canal/wiki/Docker-QuickStart
- Feature Hub for Flink and Spark https://github.com/alibaba/feathub
- https://jsoup.org/
- https://github.com/dask-contrib/dask-sql
- https://github.com/leondz/garak/
- https://github.com/zilliztech/VectorDBBench
- M1! https://github.com/apple/ml-stable-diffusion
- Fun game https://pixelastic.github.io/pokemonorbigdata/
- https://github.com/tloen/alpaca-lora
- https://shishirpatil.github.io/gorilla/
- https://github.com/boyter/cs?
- https://github.com/algolia/autocomplete?
- https://github.com/lmorg/murex
- https://github.com/keephq/keep
- https://github.com/Safiullah-Rahu/CSV-AI
- https://github.com/naushadh/hive-metastore
- https://github.com/bentoml/OpenLLM
- https://bucket4j.com/
- https://github.com/dainiusjocas/lucene-grep
- https://gpt4all.io/index.html
- https://github.com/AntonOsika/gpt-engineer
- https://github.com/linux-china/chatgpt-spring-boot-starter
- https://jsoncrack.com/
- https://github.com/slidevjs/slidev
- https://docs.flowman.io/en/latest/index.html
- https://github.com/brexhq/prompt-engineering
- https://replicate.com/andreasjansson/musicgen-looper
- https://omnimotion.github.io/
© 2020-2023 Tim Spann
