π― About
At opt-nc
, we have APIs to track package delivery as well as a web portal for end users called "OPT-NC Mon espace":
The purpose of this story telling is to show how we could imagine a performance that consists in :
creating a customized AI-driven digital assistant thanks to public APIs, on free tiers.
π¨βπ³ The recipe
Find the recipe below:
- π¦ A package
id
(as input) - π Get
API
credentials (as inputs) - ποΈ Generate a whole speech in a high quality
mp3
(and listen some bugs too π ) - π€ Do something fun with
mp3
π§° APis
as ingredients
We will rely on:
-
π¦ opt-nc/suivi-colis
to track package -
π€ llElevenLabs
for Text-to-Speech -
π SadTalker
to build a movie clip
βΉοΈ Notice that as all have free plans, you can run (and change this code) for free at you own convenience, as long as it's not for commercial purpose.
πΏ Build the soundtrack
That said, let's take a look at demo and have some fun, first, build the soundtrack (see π€ Suivi colis π€ ποΈ Notebook for more):
ποΈ Bring "Cyber Postman to life" β‘
To build the movie clip, we need two ingredients:
-
ποΈ A soundtrack: the one we have just built (
mp3
) -
π An avatar: the one I've built myself on
bluewillow.ai
Next, with some parameter tweaks on Sad Talker
, we can bring our cyber postman to life:
π The "Customer Experience" screenwriter
Beyond the fun, it makes appear the need to work on the delivery scenario speech which may be achieved in different ways:
- π Hard code the scenario with placeholders (current version) : you can get help from chatBOTs, yet the final version is static
- π¦Ύ Use variables (location, status,...) and inject into AGI ... and get an original script with a
PROMPT
template, play with temperature and get original content while keeping control - π€― Hybrid of previous ones : create a template, get an output then ask to AGI to build a brand new one on top of it and carefully design a system context
From my very own point of view, the emergence of the screenwriter role is the most exciting one.
π Resources
Take a look at π€ Suivi colis π€ ποΈ Notebook for more and discover more hacks around this API below (ask to add yours):