At Many-Worlds Studios, we're exploring the innovative frontier of LLM-driven animation with Many News, the world's first fully autonomous AI-generated news show. But "Many News" is just the tip of the iceberg. It's a testament to the power of Geppetto, our AI framework that's helping us design and deploy LLM-driven procedural animation pipelines.

The Birth of a Digital Puppet Master

The journey began with a simple question: how much of the CG animation process could we automate using LLMs? We started by building "Many News" as an experiment. Every day at midnight, Buenos Aires time, our AI agents spring to life, scraping the latest news, writing the script, animating our AI anchors Rolando and Sylvia, and even posting the finished video to social media. No humans involved!

But as we delved deeper into this process, we realized we needed a more powerful, more versatile tool. Something that could not only create a news show but could also breathe life into any story we could imagine. That's how Geppetto was born.

Think of Geppetto as a digital puppet master, capable of orchestrating entire animated scenes, characters, and stories. It's more than just an animation tool; it's a bridge between human creativity and artificial intelligence. We can use it directly, controlling every detail ourselves, or we can unleash it to generate content autonomously and recursively. For Many News, for instance, Geppetto writes simple storylines for each episode, seamlessly weaving them with the latest news reports. It even considers previous episode themes, creating evolving story arcs that can be guided (or left to unfold naturally) by the human operator (because, yes, sometimes a human touch is still needed!)

And when it comes to characters, Geppetto doesn't just create puppets; it creates minds. Each character has a background context that reflects their personality, desires, and goals. There's also a broader context layer that relates to where they are, what's going on around them, and other relevant information. Geppetto takes into consideration every layer of context to generate a "mind" for each character, from which the segment script and the character expressions and body animation are extracted.

Geppetto is being built to integrate with industry-standard 2D and 3D software, importing and exporting character or scene data to programs like Blender or Maya. Studios could use Geppetto to jumpstart their project's scene layout and animation blocking with their own character rigs, and then polish the animation or replace any shot or detail. While Geppetto integrates with voice synthesis providers, it can also work with recorded audio from human actors.

For Many News, we implemented an arbitrary website input option, so that it can create news segments based on anything – not just a news article. For example, this is the unedited output of using this same webpage as input: