Google Introduces Lumiere: Multimodal AI Video Generation Tool, Capable Of Creating Videos From Text And Images


New Delhi: Google recently introduced its newest artificial intelligence model, Lumiere, which specializes in multimodal video generation, capable of producing 5-second-long videos.

Lumiere employs a Space-Time U-Net (STUNet) architecture, which enhances the realism of motion in generated videos. Unlike traditional methods that assemble still frames, Lumiere creates videos in a single process, simultaneously addressing spatial and temporal elements to mimic natural motion.

The model generates 80 frames, a significant increase compared to Stable Diffusion’s 25 frames, and utilizes spatial and temporal down- and up-sampling along with a pre-trained text-to-image diffusion model for video generation.

While not available for public testing yet, the Lumiere website showcases videos created using the AI, along with text prompts and input images. It offers various video styles, cinemagraphs, and inpainting functionalities.

Lumiere competes with existing models like Runway Gen-2 and Pika 1.0, both accessible to the public, offering features such as video editing and shorter video generation capabilities.

Click here for Latest News updates and viral videos on our AI-powered smart news

For viral videos and Latest trends subscribe to NewsMobile YouTube Channel and Follow us on Instagram


Please enter your comment!
Please enter your name here

Share post:



More like this

Rishad, Shakib Shine As Bangladesh Keep Super 8 Hope Alive, Beat Netherlands By 25 Runs

Kingstown: Rishad Hossain's three-wicket haul and Shakib Al Hasan's...

Divya Deshmukh Wins World Junior Chess Championship 2024

Gandhinagar: In a momentous achievement on Thursday, Divya Deshmukh...

Lok Sabha Speaker Election To Be Held On June 26

New Delhi: The election for the post of Lok...

Italian PM Meloni Affirms G7’s Commitment To Global South Dialogue

Apulia: The G7 Summit commenced in Italy with a...