I aimed to start developing a tiny AI short film that depicted the story of a dragon that goes on an adventure in search for a new home after his volcano house starts erupting. At first I realized that it would be cool to start developing a ML/AI tool that assisted me in the storyboarding of this story. Thanks to the Hypercinema class, I learned how to prototype stories by using AI.
Using HTML and JavaScript, as well as runway API to create a tool that allows text to image and image to image generation. These images would be available for the user to be saved and they would place in order into a grid of cells that would serve as the storyboard scenes. The sketch/tool is not finished yet, nor polished. However, could be a nice idea for a web app.
This would be the result of the storyboard export. There’s still so much to do, even get the image to video model to turn them into video and maybe a tiny visualizer there too.
With this storyboard I went into putting all the pieces together for a first draft of this story. Also using the Runway image to video model with Veo 3.1. Although the movements are not perfect just yet and some more iteration on the story, scenes and video clips can be done, the power of AI as a mean for ideation and prototyping. Potentially, with more work and combination of AI models, can achieve a better quality product visually.