Instagram will now support Meta’s AI video tricks, which include adding bling, changing backgrounds, and using wording to alter images to improve videos.
Instagram’s head, Adam Mosseri, stated in a movie news,” I’m very excited about Movie Gen, our first AI research model that will let you change almost any aspect of your videos with a plain text prompt.
In the movie, Mosseri appears in his original clothes and location—a gray suit and a normal-looking bedroom—and the landscape starts to randomly shift, showing him in Paris, New York, and a lake, and switching his clothes to various things like a leather jacket or a plump sweater while in the Himalayas.
” You should be able to change your outfit or change the context in which you’re sitting, or add a chain, whatever you can think of”, Mosseri explained, showing off demos where he seamlessly switched backgrounds and transformed his appearance.
Meta released Movie Gen a few months ago, showcasing some generations that produced more than other models ‘ outputs in terms of quality and prompt adherence. Additionally, the business displayed some AI-generated Instagram reels created by Paige Piskin and 10pm Curfew’s Girls and K5sh accounts, both of which are owned by social media influencers.
Beyond generative video, Movie Gen handles video painting by altering specific scenes in a video while keeping the rest of the elements intact. This allows users to perform a variety of visual manipulations, from changing a person’s outfit to swapping out backgrounds, and even turning them into puppet-like cartoon characters by altering the overall aesthetic of the scene.
The technology looks to be based on Decrypt’s Movie Gen AI model, which was unveiled last year. It’s the company’s answer to similar tools from rivals, like OpenAI’s recently announced Sora video generator, Runway’s inpainting feature, and even some open-source tools like Propainter.
This is the first time Meta has directly demonstrated its video AI capabilities to Instagram users. With synchronized sound effects and music, Movie Gen can create entirely new 16-second videos or modify existing ones.
Following a somewhat quiet year with spaced-out releases, the generative video scene has been on a run lately, with significant developments coming out in the last few months.
Sora is finally out, but there have been a lot of interesting alternatives—like Invideo V3 ( capable of generating entire scripts, scenes, and 10-minute-long videos out of a single idea ), Dream Machine ( which can generate coherent and realistic videos even in surreal scenarios ), Google’s Veo2 ( capable of generating highly realistic videos with great prompt adherence ), and Showrunner ( which is able to generate small cartoon sketches ).
Meta hasn’t announced a specific launch date, but Mosseri said it’s coming in 2024.
Generally Intelligent Newsletter
A generative AI model’s generative AI model, Gen, tells a weekly AI journey.
