🤯 ridet-nc-api : service mesh API on top of heterogeneous Open Data

adriens - Jul 10 '23 - - Dev Community

🙋 About

New-Caledonia has an Open Data platform on which public organizations (aka. partners) come and share data, on various topics like:

  • 🧑‍⚕️ Health
  • 🌳 Ecology, climate & environment
  • 🧾 Taxes incomes
  • 📍 Geographic Information System (streets,...)
  • 🥬 Agriculture
  • 🎭 Culture & art
  • 📈 Economy & employment
  • 🧑‍🎓 Education
  • ⚡ Energy
  • 🏟️ Youth, sports,
  • 💻 Technology
  • 🚌 Mobility
  • ...

☝️ Unfortunately, for now, as these datasets are provided by various data providers:

Image description

, there is no real common governance on top of all these datasets.

👉 The consequence of this is that, as a developer, you want to work on a specific transversal subject,...

you'll have to deal many datasets to bring some real value, ... then achieve higher business values.

🐌 In a word, before to be able to answser specific business driven questions, you'll have to:

  1. 🔬 Learn about the dataset dictionary
  2. 💪 Deal with each dataset
  3. 🕸️ Link datasets between each others with universal keys (or maintain a referential set of keys)
  4. 🛍️ Make (create, release, deploy & maintain) this as a nice & ready-to-use API
  5. 🎯 (At last) do your stuff : work on your primary business goal

🦥 The DX word

The Developer Experience (DX) word is quite straightforward:

Everyone would rather jump-start straight to step 5... and not care about the boilerplate data side.

🪝 Pitch

This post is all about "How to make it possible to jump start to Step 5... , and most of all, how to prepare & deliver it at scale."

🍿 Demo

To discover how we handled the challenge, just enjoy the following dedicated content that will explain the whole process within a dedicated live data story telling.

🔖 Resources

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .