Meta has announced Meta Movie Gen, a new tool that uses AI to create up to 16 seconds of video at 16 frames a second.
The tool uses text prompts to create video clips with synchronised AI-generated audio. According to the company, Movie Gen can generate personalised AI videos using a single photo.
Meta said the tool is still being tested before it launches publicly.
Movie Gen has four capabilities: video generation, personalised video generation, precise video editing, and audio generation.
In a blog post, Meta said the editing variant of Movie Gen performs localised edits like adding, removing, or replacing elements, and global changes such as background or style modifications. “Unlike traditional tools that require specialised skills or generative ones that lack precision, Movie Gen preserves the original content, targeting only the relevant pixels,” said the company.
For audio, Meta trained a 13B parameter audio generation model that can take a video and optional text prompts and generate audio up to 45 seconds, including ambient sound, Foley, and instrumental background music — all synced to the video content.
“As we continue to improve our models and move toward a potential future release, we’ll work closely with filmmakers and creators to integrate their feedback,” said Meta.
By taking a collaborative approach, we want to ensure we’re creating tools that help people enhance their inherent creativity in new ways they may have never dreamed would be possible.
Meta has released more technical details in a research paper.
