17-June-2024
Tim Spann @PaaSDev
Milvus - Towhee - Attu - Feder - GPTCache - VectorDB Bench
Happy Father's Day To All! Also Happy Flag Day to Those in the United States.
AIM Weekly
Towhee - Attu - Milvus (Tim-Tam)
FLaNK - FLiPN
With a name like that I am not sure how I don't add that to my group.
SPANN: Highly-efficient Billion-scale Approximate Nearest Neighborhood Search
https://proceedings.neurips.cc/paper/2021/hash/299dc35e747eb77177d9cea10a802da2-Abstract.html
Congrats to Milvus
https://www.dbta.com/Editorial/Trends-and-Applications/DBTA-100-2024-The-Companies-That-Matter-Most-in-Data-164289.aspx
https://github.com/milvus-io/milvus
https://www.youtube.com/@FLaNK-Stack
https://www.threads.net/@tspannhw
https://medium.com/@tspann/subscribe
https://ossinsight.io/analyze/tspannhw
CODE + COMMUNITY
Please join my meetup group NJ/NYC/Philly/Virtual.
https://www.meetup.com/unstructured-data-meetup-new-york/
This is Issue #142
New Releases
Milvus Release 2.4.4
https://milvus.io/docs/release_notes.md
Release date: May 31, 2024
It includes a critical bug fix, so if you use bulk insert definitely upgrade now. Also some compilation updates for other platforms.
https://github.com/milvus-io/milvus/releases/tag/v2.4.4
Hardware
Upcoming
Summary of the Last Awesome Meetup
https://www.linkedin.com/feed/update/urn:li:activity:7202803256891248640/
Cool Stuff
TIMM (Pytorch Image Models)
https://timm.fast.ai/
Ben has gone deep on this article on the Future of Vector Search linking to some of Milvus & Zilliz' scalability and horizontal scalability deep description and highlighting a lot of interesting things going on.
https://gradientflow.substack.com/p/the-future-of-vector-search
See:
https://zilliz.com/learn/scaling-vector-databases-to-meet-enterprise-demands?utm_source=tim
Articles
There's a lot of cool stuff with Milvus and new models, techniques, libraries and use cases.
https://medium.com/@tspann/not-every-field-is-just-text-numbers-or-vectors-976231e90e4d
https://medium.com/@tspann/unstructured-street-data-in-new-york-8d3cde0a1e5b
https://medium.com/@tspann/tech-week-soft-meetup-debut-june-2024-fc4cdf79342d
https://medium.com/@tspann/shining-some-light-on-the-new-milvus-lite-5a0565eb5dd9
https://www.infoq.com/presentations/ai-monopoly/
https://python.plainenglish.io/claude-3-the-king-of-data-extraction-f06ad161aabf
https://zilliz.com/blog/exploring-multimodal-embeddings-with-fiftyone-and-milvus
https://medium.com/aiguys/yolov9-new-object-detection-king-6fc97b93dc9a
https://medium.com/@zilliz_learn/milvus-reference-architectures-e30a27c9f3c2
https://docs.openlit.io/latest/integrations/milvus
https://builtin.com/articles/real-time-data-ai
https://medium.com/@zilliz_learn/semantic-search-with-milvus-and-openai-32573de80307
https://gradientflow.substack.com/p/the-future-of-vector-search
https://medium.com/@zilliz_learn/local-agentic-rag-with-langgraph-and-llama-3-6c962979821f
https://blogs.nvidia.com/blog/nemotron-4-synthetic-data-generation-llm-training/?utm_source=tim
DSPy - Getting interesting
https://medium.com/@sandyeep70/the-decline-of-traditional-prompt-engineering-and-the-rise-of-dspy-b27b9a5adc45
Why How + Milvus Lite
https://medium.com/enterprise-rag/kickstart-your-genai-applications-with-milvus-lite-and-whyhow-ais-open-source-rule-based-retrieval-70873c7576f1
Videos
Using JSON Fields with Milvus
https://www.youtube.com/watch?v=HP5L3Hr6Mt8
Street Cams + Milvus
https://medium.com/@tspann/unstructured-street-data-in-new-york-8d3cde0a1e5b
Conf42: ML: Emerging GenAI
https://youtu.be/ktVVdJB306U?feature=shared
Generative AI with Milvus
https://www.youtube.com/watch?v=IfWIzKsoHnA
SF Unstructured Meetup - 03 June 2024
https://www.youtube.com/watch?v=UobR3czXqSo&ab_channel=Zilliz
Fueling AI with Airbyte
https://zilliz.com/event/fueling-ai-with-great-data-airbyte?utm_campaign=2024-06-13_webinar_Airbyte-fueling-ai-with-great-data_zilliz&utm_medium=tim
Milvus Webinar
https://www.youtube.com/watch?v=IowBdkeKi_M
AI Generated Videos
https://youtu.be/5tJDBSDrKLQ
https://www.youtube.com/watch?v=YNh-WNFLe98
Voyage AI Embeddings and Rerankers for Search and RAG
https://medium.com/@zilliz_learn/voyage-ai-embeddings-and-rerankers-for-search-and-rag-587d9bfff877
Evaluate RAG Apps
https://medium.com/@zilliz_learn/how-to-evaluate-rag-applications-e2936c1275f9
Slides
https://ml.dssconf.pl/user.html#!/lecture/DSSML24-041a/rate
https://www.slideshare.net/slideshow/dssml24_tspann_codelessgenerativeaipipelines/269634571
Events
June 18, 2024: Princeton Meetup
https://www.meetup.com/applied-generative-artificial-intelligence-applications/events/301336510/
https://www.startupgrind.com/events/details/startup-grind-princeton-presents-genai-gathering/
June 20, 2024: AI Camp Meetup. NYC.
https://www.meetup.com/unstructured-data-meetup-new-york/events/301383476/
Nov 5-7, 10-12, 2024: CloudX. Online/Santa Clara. https://www.developerweek.com/cloudx/
Nov 19, 2024: XtremePython. Online.
https://xtremepython.dev/2024/
Code
- https://github.com/tspannhw/FLaNK-python-processors
- https://github.com/tspannhw/AIM-MilvusLite
- https://github.com/tspannhw/AIM-NYCStreetCams
- https://github.com/stephen37/Milvus_demo/tree/main/llama_index_demos
- https://github.com/tspannhw/AIM-MotorVehicleCollisions
Models
- https://huggingface.co/mistralai/Codestral-22B-v0.1
- https://huggingface.co/mixedbread-ai/mxbai-embed-large-v1
- https://www.mixedbread.ai/blog/mxbai-embed-large-v1
- https://huggingface.co/nvidia/Nemotron-4-340B-Instruct
- https://huggingface.co/nvidia/Nemotron-4-340B-Reward
- https://huggingface.co/spaces/allenai/reward-bench
Tools
- https://github.com/verazuo/jailbreak_llms
- https://github.com/open-webui/open-webui
- https://datafusion.apache.org/user-guide/example-usage.html
- https://github.com/timeseries/qstudio
- https://github.com/redotvideo/revideo
- https://github.com/coqui-ai/TTS
- https://flameshot.org/
- https://github.com/dflib/dflib
- https://valentinaalto.medium.com/rag-with-phi-3-medium-as-a-model-as-a-service-from-azure-model-catalog-62e1411948f3
- https://github.com/iyaja/llama-fs
- https://github.com/airbnb/chronon?
- https://huggingface.co/stabilityai/stable-audio-open-1.0
- https://github.com/keylase/nvidia-patch
- https://github.com/livekit/livekit
- https://github.com/1943time/bluestone
- https://litellm.vercel.app/docs/simple_proxy
- https://github.com/cohere-ai/cohere-toolkit
- https://github.com/lavague-ai/LaVague
- https://contrib.rocks/preview?repo=milvus-io%2Fmilvus
- https://github.com/mrHeavenli/akkufetch
- https://github.com/visual-layer/fastdup
- https://github.com/fastfetch-cli/fastfetch
- https://github.com/allenai/PlaSma
- https://github.com/letmutex/htmd
- https://github.com/rossant/collatepdf
- https://github.com/milvus-io/milvus-haystack
Cool
Let's do the Time Sync Again
https://github.com/milvus-io/milvus/blob/master/docs/design_docs/20211215-milvus_timesync.md
© 2020-2024 Tim Spann https://www.youtube.com/@FLaNK-Stack
FLaNK-AIM with LLAMA 3
~~~~~~~ CONNECT ~~~~~~~
🎥 Playlist: Unstructured Data Meetup https://www.meetup.com/unstructured-data-bay-area/events/
🖥️ Website: https://www.youtube.com/@MilvusVectorDatabase/videos
X Twitter - / milvusio https://x.com/milvusio
🔗 Linkedin: / zilliz https://www.linkedin.com/company/zilliz/
😺 GitHub: https://github.com/milvus-io/milvus
🦾 Invitation to join discord: / discord https://discord.com/invite/FjCMmaJng6