Google Introduces Lumiere: Multimodal AI Video Generation Tool, Capable Of Creating Videos From Text And Images


New Delhi: Google recently introduced its newest artificial intelligence model, Lumiere, which specializes in multimodal video generation, capable of producing 5-second-long videos.

Lumiere employs a Space-Time U-Net (STUNet) architecture, which enhances the realism of motion in generated videos. Unlike traditional methods that assemble still frames, Lumiere creates videos in a single process, simultaneously addressing spatial and temporal elements to mimic natural motion.

The model generates 80 frames, a significant increase compared to Stable Diffusion’s 25 frames, and utilizes spatial and temporal down- and up-sampling along with a pre-trained text-to-image diffusion model for video generation.

While not available for public testing yet, the Lumiere website showcases videos created using the AI, along with text prompts and input images. It offers various video styles, cinemagraphs, and inpainting functionalities.

Lumiere competes with existing models like Runway Gen-2 and Pika 1.0, both accessible to the public, offering features such as video editing and shorter video generation capabilities.

Click here for Latest News updates and viral videos on our AI-powered smart news

For viral videos and Latest trends subscribe to NewsMobile YouTube Channel and Follow us on Instagram


Please enter your comment!
Please enter your name here

Share post:



More like this

Two Killed As Luxury Car Hits Motorcycle In Pune; Minor Held

Pune: In a tragic incident two individuals lost their...

IPL 2024: Punjab Kings Win Toss, Elect To Bat First Against SRH

Hyderabad: Punjab Kings (PBKS) skipper Jitesh Sharma won the...

We Protested To Get Justice For Nirbhaya, Now We Are Saving An Accused: Swati Maliwal

New Delhi: Aam Aadmi Party (AAP) Rajya Sabha MP...