Do you remember those silly AI-generated videos with freakish proportions and weird hands? Meta Movie Gen shows that AI-made content has evolved to become more visually appealing than ever.
The Facebook company’s latest post shows that the program can create 16-second HD-quality clips based on simple text prompts. It can also add sound effects and even incorporate a user’s likeness.
READ: The Gen Z Filipinos’ guide to workplace success
Meta acknowledged that its AI tool is a work in progress. However, the goal is not to replace artists and animators but to empower everyone to express their artistic visions.
How does Meta Movie Gen work?
The official Meta Movie Gen website shows its amazing AI-generated samples, such as a little girl running across a beach while holding a kite.
The samples show none of the usual issues with AI-generated videos, like the unnatural sheen or the misshapen limbs. Moreover, Meta claims its tool is the first to create long, high-definition videos at different aspect ratios.
Even better, the command options for Movie Gen allow for detailed descriptions. For example, here’s one of the sample prompts:
“A red-faced monkey with white fur is bathing in a natural hot spring. The monkey is playing in the water with a miniature sailship in front of it, made of wood with a white sail and a small rudder. The hot spring is surrounded by lush greenery, with rocks and trees.”
Meta Movie Gen can also generate audio for the videos and extend them into background music or full-blown soundtracks.
For example, the AI tool generated sound for a clip featuring a man overlooking a waterfall with this prompt:
“Rain pours against the cliff and the person, with music playing in the background.”
Existing videos can be transformed with text inputs, which simplifies editing significantly. For example, backgrounds or outfits can be added to the subjects.
Finally, photos can be uploaded to turn them into videos. For example, Meta Movie Gen made a video of a man playing with a dog.
Unlike previous AI-generated clips, the person’s head moves with light and other elements, affecting its realism.
Meta has not confirmed when it will let the public use Movie Gen. Nevertheless, it hopes its research helps “accelerate progress and innovation in media generation models.”