How I Got My First Rust Job by Doing Open Source

Edwin Kys - Apr 30 - - Dev Community

Hi everyone πŸ‘‹

I just want to share my story and my most recent achievement about landing on a Rust-oriented software engineering position at a startup by creating and maintaining an open-source project, OasysDB, an embedded vector database.

I initially posted this on Reddit and it received more attention than I could ever imagine. I also got a lot of questions from the community about starting an open-source projects or getting hired in general.

So, in addition to the content in my original Reddit post, I will expand it a bit more to answers some of these stuff.

Around 2 weeks ago now, someone opened an issue on OasysDB to integrate it to his platform, Indexify, an open-source platform to extract and process various unstructured data from different sources for generative AI apps in real-time.

He also connected with me via LinkedIn (my username is the same across all platforms πŸ˜‚). He noticed that I had my #OpenToWork badge on and asked me if I'm looking for a job.

I was like Yes! and told him that if his company is hiring, I'd love to apply. Apparently, he was actually hiring. We then scheduled a call and chatted about Indexify and OasysDB, The motivation behind it, the goal, and some other stuff.

We also had another call the day after. An interview of some sort but way more casual. We discussed about the team, the vision, and other stuff related to the role. He made the decision to bring me in so fast that it kind of mindblowing 🀯

We discussed the compensation over the weekend and after signing in some paperwork, I got my first Rust-oriented job! I started working last Monday and so far, I'm loving it. The team is also very helpful and friendly making the orientation period much more enjoyable.

I just want to say, if you're currently struggling to land a software engineering position, it might be worth it to try expanding your network by doing different stuff. Contributing or creating an open-source project is one of them 😁

Anyway, if you have any question, feel free to ask me in the comment!

I add some extra content below. Don't forget to check it out :)

Why I created OasysDB

I initially created OasysDB to learn more about Rust and vector indexing. I had no prior experience with Rust and the only experience I had with vector databases was using them at the previous startup I worked at to build a custom RAG pipeline.

So, yeah. I don't even know what got into me πŸ˜‚

I came from Python and Typescript and my whole professional experience as a software engineer revolves around working with startups. One that I started myself and the other as a co-founder/founding engineer.

So with that, I have a pretty diverse skillset from web development both frontend and backend, devops, other engineering-related skills to UI/UX designs and even administrative stuff like incorporation.

Anyway, my point is that I'm adaptable and willing to learn.

After I got laid off from my previous job (the startup didn't take off), I decided that I wanted to add a new programming language to my arsenal.

I watched a couple of YouTube videos and read a couple of blog posts and decided to give Rust a try.

My favorite way to learn something new is to create a project using it. Since I read that Rust is a good language to create a database in and I have some experience with vector database, I decided to make just that.

Oh what a rough couple of weeks following that simple-minded decision πŸ˜…

I ended up learning more than just Rust and vectors. I learned a lot about creating and growing a open-source community, supporting the early users of OasysDB, and many other things both engineering and non-engineering related.

Overall, it is a wholesome experience that I would recommend anyone to try.

Self-promotion really quick 🀣, this is OasysDB now:

GitHub logo oasysai / oasysdb

An embedded vector database designed to run on edge devices. Lightweight and fast with HNSW indexing algorithm.

πŸ“£ Announcement

Many thanks to everyone who supported OasysDB to progress this far. After thorough consideration, I have decided to pivot the project to a new direction. I will be focusing OasysDB to be a more robust vector database solution for production workload with ground-up support for hybrid ANN search algorithms.

This will come with a lot of changes to the project structure, API, and functionality. I will be working on this in the coming weeks and months. I will keep you updated on the progress and the new direction of OasysDB.

~ Edwin

OasysDB Use Case

GitHub Stars Discord

Crates.io PyPI

License Contributor Covenant

πŸ‘‹ Meet OasysDB

OasysDB is a flexible and easy-to-use vector database written in Rust. It is designed with simplicity in mind to help you focus on building your AI application without worrying about database setup and configuration.

With 3 different runtime modes, OasysDB will accompany you throughout your journey from the early stages of development to…

Also, this is Indexify, the open-source platform I'm currently working at:

GitHub logo tensorlakeai / indexify

A realtime and indexing and structured extraction engine for Unstructured Data to build Generative AI Applications

Indexify

Tests Discord

Examples | Indexify Extractors | Python Client | TypeScript Client

Indexify High Level

LLM applications backed by Indexify will never answer outdated information.

Indexify is an open-source engine for building fast data pipelines for unstructured data(video, audio, images and documents) using re-usable extractors for embedding, transformation and feature extraction. Indexify keeps vectordbs, structured databases(postgres) updated automatically when pipelines produce embedding or structured data.

Applications can query indexes and databases using semantic search and SQL queries.

Differences with Batch/ETL Systems

ETL-based ingestion systems process files in batches, suitable for offline use cases with infrequent data updates. In contrast, Indexify’s pipelines function as live APIs, instantly processing files or text upon ingestion like any online system. Indexify efficiently schedules data processing tasks across thousands of machines, enabling real-time extraction for RAG applications or agents where up-to-date indexes are crucial.

More Cool Features!

  • Incremental Extraction when content is updated. Indexfiy processes only the chunks which…

Improving a chance to get hired (Community)

In addition to, of course, applying for jobs via some job boards like Indeed or LinkedIn, these are some other things you can try to get hired.

By the way, if you have things that work for you that I don't have in this list, please share and I'll add it to the list so that this list can help more people too 😁

  • Creating an open-source project: The project also functions as your portfolio of some sort. When people use your project, connect with them and help them succeed using it.

  • Local professional networking: Meeting people in person builds a deeper connection faster. Exchange contacts and don't forget to keep in touch with them.

  • Volunteer teaching how to code: There are programs like Code in Place teaching people how to code where you can volunteer as a teacher and connect with other teachers.

  • Comment your own experience 😁

. .