🎬 From image to text data... to image...to movie clip.

adriens - Jun 5 - - Dev Community

πŸ“° About

I previously wrote an article that showed, how, for totally free of charge, and with 100% open source software, it is possible to analyze photos and produce textual analysis:

πŸ‘‰ Today, I'll show, what can be achieved on top of these textual analysis.

πŸ“œ What we'll do

This time, we will enrich the previous pipeline with the following workflow:

  1. 🎨 text2img: inject text analysis into an image with https://ideogram.ai
  2. 🎬 img2video : Put resulting image into Gen-2 by Runway to get a movie clip with
  3. πŸŽ™οΈ Prepare a small storytelling
  4. 🎢 Select a soundtrack
  5. πŸŽ›οΈ Put all the stuff into a single short movie clip

Enough talk, here is the resulting movie clip.

🎞️ Demo

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .