Placeholder canvas

Google Introduces Lumiere: Multimodal AI Video Generation Tool, Capable Of Creating Videos From Text And Images


New Delhi: Google recently introduced its newest artificial intelligence model, Lumiere, which specializes in multimodal video generation, capable of producing 5-second-long videos.

Lumiere employs a Space-Time U-Net (STUNet) architecture, which enhances the realism of motion in generated videos. Unlike traditional methods that assemble still frames, Lumiere creates videos in a single process, simultaneously addressing spatial and temporal elements to mimic natural motion.

The model generates 80 frames, a significant increase compared to Stable Diffusion’s 25 frames, and utilizes spatial and temporal down- and up-sampling along with a pre-trained text-to-image diffusion model for video generation.

While not available for public testing yet, the Lumiere website showcases videos created using the AI, along with text prompts and input images. It offers various video styles, cinemagraphs, and inpainting functionalities.

Lumiere competes with existing models like Runway Gen-2 and Pika 1.0, both accessible to the public, offering features such as video editing and shorter video generation capabilities.

Click here for Latest News updates and viral videos on our AI-powered smart news

For viral videos and Latest trends subscribe to NewsMobile YouTube Channel and Follow us on Instagram


Please enter your comment!
Please enter your name here

Share post:



More like this

Lok Sabha Polls: EC Extends Poll Timings In Bihar LS Seats Due To Heatwave

New Delhi: The Election Commission (EC) has announced an...

IPL 2024: Delhi Capitals Defeat Gujarat Titans By Four Runs In Last-Ball Thriller

New Delhi: A stellar all-round performance by Delhi Capitals...