Timothy Spann. 🇺🇦Dec 12, 2022 FLiP Stack Weekly
People are FLiPN out about https://chat.openai.com/chat. It is a game changer, add another few years and this should be 10x better.
ChatGPT wrote me this Pulsar function:
import org.apache.pulsar.functions.api.Context;
import org.apache.pulsar.functions.api.Function;
public class BertQAFunction implements Function<String, String> {
@Override
public String process(String input, Context context) {
// Parse the input JSON into a Java object using a JSON library
// such as Jackson or Gson
MyJsonObject json = parseJson(input);
// Use the Bert QA library to perform QA on the JSON object
BertQAResult result = BertQA.runQA(json);
// Return the result as a JSON string
return result.toJson();
}
}
`
I then tried to build 50 more. Some are good, some are minimal, some are bad and some are just shells. An interesting start and some good ideas on functions to build. I offer the source as a starter for anyone wanting to build some functions.
https://github.com/tspannhw/pulsar-chatgptgenerated-functions
Check out our channel:
https://www.youtube.com/@streamnativecommunity8124/featured
New Stuff
https://cwiki.apache.org/confluence/display/NIFI/Release+Notes#ReleaseNotes-Version1.19.0
A quick preview of Apache Pulsar + Apache Pinot.
https://github.com/tspannhw/pulsar-thermal-pinot
PODCAST
Take a look at recent podcasts in audio or video format.
https://www.youtube.com/watch?v=U8aPBhlvDHU&feature=emb_imp_woyt
{% embed https://www.youtube.com/watch?v=U8aPBhlvDHU&feature=emb_imp_woyt %}
CODE + COMMUNITY
Join my meetup group NJ/NYC/Philly/Virtual.
https://www.meetup.com/new-york-city-apache-pulsar-meetup/
This is Issue #62!!
https://github.com/tspannhw/FLiPStackWeekly
https://www.linkedin.com/pulse/2022-schedule-tim-spann
VIDEOS
{% embed https://www.youtube.com/watch?v=gCroAjk5D_Q %}
https://www.youtube.com/watch?v=gCroAjk5D_Q
{% embed https://www.youtube.com/embed/gCroAjk5D_Q %}
https://www.youtube.com/watch?v=Z9zAnKBcGKI
{% embed https://www.youtube.com/watch?v=Z9zAnKBcGKI %}
https://www.youtube.com/watch?v=VhVs6fuf7W8
{% embed https://www.youtube.com/watch?v=VhVs6fuf7W8 %}
https://www.youtube.com/watch?v=sJB0Fwxy2ck
{% embed https://www.youtube.com/watch?v=sJB0Fwxy2ck %}
https://www.youtube.com/watch?v=4Fh48IL3rUA
https://www.youtube.com/watch?v=vwLxV48JhbQ
https://www.youtube.com/watch?v=MN2l1duMjeA
https://www.youtube.com/watch?v=apY1Xd5JgkA
https://www.youtube.com/watch?v=BpXJboPWpAY
https://www.youtube.com/watch?v=lepXk0u4iQ4
https://www.youtube.com/watch?v=v7qYBQVFz_k
https://www.youtube.com/watch?v=txidgG7xcYE
https://www.youtube.com/watch?v=wNkdH1A7C_s
ARTICLES
https://medium.com/@isuriamasarani87/why-http-is-a-bad-idea-for-microservices-f82e99eff9a0
https://medium.com/@tspann/using-apache-pulsar-with-cloudera-sql-builder-apache-flink-b518aa9eadff
https://www.infoq.com/articles/serverless-websockets-realtime-messaging/
https://blogs.oracle.com/java/post/go-native-with-spring-boot-3-and-graalvm
https://medium.com/@nifi.notes/building-an-effective-nifi-flow-queryrecord-cca5ba51afd5
https://medium.com/@nifi.notes/building-an-effective-nifi-flow-b5aa1b816380
http://funnifi.blogspot.com/2022/12/using-updatedatabaserecord-for-schema.html
https://www.infoq.com/news/2022/10/apache-inlong-framework/
https://www.infoq.com/articles/streaming-first-real-time-ml/
https://www.infoq.com/presentations/ml-continuous-learning/
https://dev.to/hs/micronaut-pulsar-6bo
https://blog.rockthejvm.com/pulsar-flink/
https://dzone.com/articles/how-to-choose-the-right-messaging-system-for-your
https://pulsar.apache.org/docs/2.10.x/cookbooks-non-persistent/
https://towardsdatascience.com/whats-next-for-data-engineering-in-2023-7-predictions-b57e3c1bf2d3
TRAINING
Dates are January 17 - 19, 2023 from 2pm - 5pm CET / 8am - 12pm EST
Link to register: https://www.eventbrite.com/e/465055021087
https://streamnative.io/training/
CODE
https://github.com/tspannhw/pulsar-csp-ce
https://github.com/tspannhw/pulsar-thermal-pinot
https://github.com/tspannhw/create-nifi-pulsar-flink-apps
https://github.com/flipkart-incubator/pulsar-weighted-consumer
https://docs.dapr.io/reference/components-reference/supported-pubsub/setup-pulsar/
https://github.com/micronaut-projects/micronaut-pulsar/tree/master/examples/full-java-example
EVENTS
Dec 14, 2022: Manhattan, NYC: Pulsar + Pinot Meetup
https://www.meetup.com/new-york-city-apache-pulsar-meetup/events/289817171/
Dec 15, 2022: TigerLabs, Princeton, NJ: Pulsar + NiFi + Flink Meetup
https://www.meetup.com/new-york-city-apache-pulsar-meetup/events/289674210/
Data Science Camp Online
Feb 15, 2023: Scylla Summit. Virtual
https://www.scylladb.com/scylladb-summit-2023/
HTAP Summit
Coming soon.
Pinot / Pulsar Meetup
Coming soon.
CockroachDB NYC Meetup
Hazelcast Event
https://docs.hazelcast.com/hazelcast/5.1/integrate/pulsar-connector
TOOLS
- https://bret.dk/pi-zero-showdown/
- https://mangopi.org/mangopi_mqpro
- https://github.com/ananthdurai/schemata
- https://github.com/mattkrick/trebuchet-client
- https://archive.ph/2022.12.07-180110/https://git.herrbischoff.com/awesome-macos-command-line/about/
- https://marketplace.visualstudio.com/items?itemName=chunkypixel.atari-dev-studio
- https://github.com/max-sixty/aoc-gpt
- https://github.com/willmcgugan/faqtory
- https://github.com/daochenzha/dreamshard
- https://www.githubtrends.io/
- https://github.com/monoid-privacy/monoid
- https://github.com/RomanHotsiy/commitgpt
- https://github.com/ehmicky/modern-errors
- https://github.com/wong2/chat-gpt-google-extension
- https://www.warp.dev/
- https://github.com/niedzielski/cb
- https://seatunnel.apache.org/docs/connector-v2/source/pulsar
- https://github.com/facebook/prophet
- https://github.com/albfan/miraclecast
- A Hackable text editor
TIPS
`
docker exec -it pulsar bin/pulsar-admin topics get-retention persistent://public/default/items
`
Another tip is don't run ChatGPT created functions on a cluster.
JOBS
https://jobs.lever.co/stream-native/74d75fc1-1ad7-40a0-b907-66d8ac86009a
