Research
Partnering with Blumhouse, creators, and the entertainment industry as we develop Meta Movie Gen
October 17, 2024
3 minute read

We recently introduced Meta Movie Gen—a suite of AI models that show how you can use simple text inputs to produce custom videos and sounds, edit existing videos, and transform your personal image into a unique video. Movie Gen models generate high-quality, 1080p HD video with corresponding audio tracks. At launch, we shared our plans to work closely with filmmakers and creators to integrate their feedback as we continue working on these models. Today, we’re excited to share some initial results from our work with award-winning production company Blumhouse and select creators, which is part of a pilot program focused on creative industry feedback. We’ll continue to expand this program in 2025.

“While we’re not planning to incorporate Movie Gen models into any public products until next year, Meta feels it’s important to have an open and early dialogue with the creative community about how it can be the most useful tool for creativity and ensure its responsible use,” says Connor Hayes, VP of GenAI at Meta.

For the pilot, Blumhouse—a driving force in horror—selected a group of filmmakers to test out the technology and provide feedback before its public debut. Those filmmakers—Aneesh Chaganty (Searching, Run), The Spurlock Sisters (The Breakline and participants in Blumhouse’s first annual Screamwriting Fellowship), and Casey Affleck (I’m Still Here, Light of My Life)—collaborated with our generative AI researchers to try out the tools and then used generated video clips as part of larger pieces. Chaganty’s short film and experimental videos from creators such as artist Paige Piskin and travel photographer Eric Rubens are available on Meta’s Movie Gen page. The short films from Affleck and The Spurlock Sisters are forthcoming.

“Artists are and forever will be the lifeblood of our industry. Innovation and tools that can help those artists better tell their stories is something we are always keen to explore, and we welcomed the chance for some of them to test this cutting-edge technology and give their notes on its pros and cons while it’s still in development,” notes Jason Blum, founder and CEO of Blumhouse. “These are going to be powerful tools for directors, and it’s important to engage the creative industry in their development to make sure they’re best suited for the job.”

Through this pilot, we’ve received invaluable feedback so far from the directors involved. While there’s no replacement for hands-on filmmaking experience, Movie Gen models were able to help them more quickly express their creative ideas and explore visual direction, tone, and mood. We heard that filmmakers see potential for Movie Gen as a collaborator and thought partner, with its unexpected response to text prompts inspiring new ideas. Movie Gen’s audio capabilities allowed the directors to explore possibilities for background audio and generate sound effects. And the longer the directors used Movie Gen—to play with the tooling, learn its nuances, and find inspiration from the models—the more they saw its potential as a creative tool.

We want to empower people to express themselves and their ideas. In the future with Movie Gen models in Meta products, you’ll be able to tap into your inherent creativity and unlock new possibilities. But we can’t do it alone. That’s why we’re extending our pilot into 2025. The pilot already gave members of our internal creative and technical teams the opportunity to work alongside directors and learn more about their creative process and needs, which resulted in actionable, concrete feedback we can now focus on implementing before these tools are released to the public—and we’re excited to continue that work. Participants will generate and edit videos using Movie Gen and give their candid, practical feedback about what works and what doesn’t as we continue to develop the models and user interfaces. In addition to our entertainment industry partners, we’ll also be partnering with digital-first content creators.

By giving creatives a new suite of tools to bring their stories to life, our hope is that Movie Gen helps even more people share their unique visions with the world.

Click here to learn more about Movie Gen.


Share:

Our latest updates delivered to your inbox

Subscribe to our newsletter to keep up with Meta AI news, events, research breakthroughs, and more.

Join us in the pursuit of what’s possible with AI.

Related Posts
Responsible AI
Connect 2024: The responsible approach we’re taking to generative AI
September 25, 2024
FEATURED
Open Source
Llama 3.2: Revolutionizing edge AI and vision with open, customizable models
September 25, 2024
Research
Sharing new research, models, and datasets from Meta FAIR
June 18, 2024