skip to content

Google Introduces Lumiere: Multimodal AI Video Generation Tool, Capable Of Creating Videos From Text And Images


New Delhi: Google recently introduced its newest artificial intelligence model, Lumiere, which specializes in multimodal video generation, capable of producing 5-second-long videos.

Lumiere employs a Space-Time U-Net (STUNet) architecture, which enhances the realism of motion in generated videos. Unlike traditional methods that assemble still frames, Lumiere creates videos in a single process, simultaneously addressing spatial and temporal elements to mimic natural motion.

The model generates 80 frames, a significant increase compared to Stable Diffusion’s 25 frames, and utilizes spatial and temporal down- and up-sampling along with a pre-trained text-to-image diffusion model for video generation.

While not available for public testing yet, the Lumiere website showcases videos created using the AI, along with text prompts and input images. It offers various video styles, cinemagraphs, and inpainting functionalities.

Lumiere competes with existing models like Runway Gen-2 and Pika 1.0, both accessible to the public, offering features such as video editing and shorter video generation capabilities.

Click here for Latest News updates and viral videos on our AI-powered smart news

For viral videos and Latest trends subscribe to NewsMobile YouTube Channel and Follow us on Instagram


Please enter your comment!
Please enter your name here

Share post:



More like this

We Have To Keep Exerting Pressure: EAM Jaishankar On India’s Bid For Permanent UNSC Seat

Shimla: External Affairs Minister S Jaishankar on Tuesday, reaffirmed...

Rajasthan: Churu Records 50.5 Degrees; Pilani Breaks Record Of Highest-Ever Temperature

Jaipur: Rajasthan is currently facing intensified heatwave conditions, with...

Spain, Norway, Ireland Formally Recognise Palestinian Statehood; Israel Denounces Move

Tel Aviv: After making the announcement a week back,...

Maliwal Assault Case: Delhi Court Extends Bibhav Kumar’s Police Custody By 3 Days

New Delhi: The Tis Hazari court on Tuesday extended...