🎬 From image to text data... to image...to movie clip.

adriens - Jun 5 - - Dev Community

📰 About

I previously wrote an article that showed, how, for totally free of charge, and with 100% open source software, it is possible to analyze photos and produce textual analysis:

👉 Today, I'll show, what can be achieved on top of these textual analysis.

📜 What we'll do

This time, we will enrich the previous pipeline with the following workflow:

  1. 🎨 text2img: inject text analysis into an image with https://ideogram.ai
  2. 🎬 img2video : Put resulting image into Gen-2 by Runway to get a movie clip with
  3. 🎙️ Prepare a small storytelling
  4. 🎶 Select a soundtrack
  5. 🎛️ Put all the stuff into a single short movie clip

Enough talk, here is the resulting movie clip.

🎞️ Demo

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .