I’m preparing to release an EP of original music, so video content is on my mind. I’m aware there’s a lot of debate about using generative AI in creative work, but given my budget and lack of connections to people who make music videos, it’s hard not to wonder what I might be able to do with some of these AI tools. Sharing this partly as a reminder for myself to explore further.
Sure, you could use AI to summarize papers and explain them at a level anyone could understand... or you can turn the abstracts into music videos for no reason.
The tools are obviously not perfect yet, but the disparate elements (consistent characters, lip syncing, etc.) are evolving fast
This was obviously for fun, and not a serious proposal, but I find doing little experiments is a good way to understand the state of AI and its limits
It took about 15 minutes. I generated the song with Suno, the initial image with Midjourney, used Veo 3 for all the videos, & then Sync for lip sync