Categories: Enterteiment

Gemini: Google's artificial intelligence could also drive vehicles for you

Spread the love

© Iv-olga/Shutterstock.com

Google’s Gemini AI models can already answer our questions, help us organize ourselves, write documents, or even code applications. But in the not-so-distant future, Gemini could also… drive vehicles. In any case, this is the new avenue being explored by Waymo, the subsidiary of Alphabet (Google’s parent company) specializing in autonomous vehicles and robotaxis.

Today, Waymo is the leader in its field. The Alphabet subsidiary already offers a competitor to Uber that operates autonomous cars in a few American cities, and which carries out more than 150,000 trips per week. And while Waymo is happy with the technologies it currently uses, it is now exploring the possibility of improving its autonomous vehicles by using Gemini's intelligence.

In a recent publication, Waymo presents a scientific article in which it describes a new technology called End-to-End Multimodal Model for Autonomous Driving. “Powered by Gemini, a large multimodal language model developed by Google, EMMA uses a unified end-to-end trained model to generate future autonomous vehicle trajectories directly from sensor data. Trained and optimized specifically for autonomous driving, EMMA leverages Gemini’s vast global knowledge to better understand complex scenarios on the road,” Waymo’s statement reads.

Why use Gemini ?

Waymo’s current approach relies on multiple independent modules to perform the various tasks of autonomous driving. The advantage of this system is that it makes it easier to debug and optimize each module separately. However, it has a scalability problem. And this system would have difficulty adapting to new environments, because it is optimized for targeted scenarios.

200% Deposit Bonus up to €3,000 180% First Deposit Bonus up to $20,000

The use of large multimodal language models (which understand both text and images) could solve this scalability problem. “Indeed, MLLMs, as general-purpose baseline models, excel in two key areas: (1) they are trained on large, internet-scale datasets that provide rich “world knowledge” beyond what is contained in common driving logs, and (2) they demonstrate superior reasoning capabilities through techniques such as thought chain reasoning,”, Waymo’s paper reads.

Challenges Ahead

But for now, while the potential for using generative AI in self-driving cars is huge, Waymo believes there are still significant challenges ahead. For example, Waymo’s EMMA system still has limitations in its ability to process video. Additionally, it only understands images, not data from more complex sensors, such as LiDAR sensors.

“While EMMA is showing promising results, it is still in its early stages with challenges and limitations in onboard deployment, spatial reasoning capability, interpretability, and closed-loop simulation. Despite this, we believe our EMMA findings will inspire further research and advancements in this field,” the Waymo paper says.

  • Gemini can already summarize emails, answer questions, and generate computer code
  • But this could later be used by the driving systems of autonomous cars
  • Waymo, the robotaxis specialist, has imagined a new system based on Gemini to manage autonomous driving
  • But for the moment, the work is only in its early stages, because, while this system has enormous potential, it also has significant limitations that will first have to be eliminated

📍 To not miss any Presse-citron news, follow us on Google News and WhatsApp.

[ ]

Teilor Stone

Teilor Stone has been a reporter on the news desk since 2013. Before that she wrote about young adolescence and family dynamics for Styles and was the legal affairs correspondent for the Metro desk. Before joining Thesaxon , Teilor Stone worked as a staff writer at the Village Voice and a freelancer for Newsday, The Wall Street Journal, GQ and Mirabella. To get in touch, contact me through my teilor@nizhtimes.com 1-800-268-7116

Recent Posts

Pass on your personal data so that we don’t eat insects

Photo: Annik MH de Carufel Archives Le Devoir Le Parti conservateur du Canada cible les…

4 minutes ago

Trump nominates Scott Bessent as Treasury Secretary

Photo: Matt Kelley Associated Press Investor Scott Bessent at a Donald Trump campaign rally in…

4 minutes ago

Israeli strike on residential building in heart of Beirut

Photo: Ibrahim Amro Agence France-Presse Smoke rises from the site of an Israeli airstrike targeting…

4 minutes ago

I switched from the Freebox Ultra to the Bouygues Pure fiber offer and the promise was not kept

© Lemon squeezer The race for speeds is raging between French operators. Free hit hard…

1 hour ago

Netflix: Who are these psychopaths who watch their series at speed 1.5 ?

© Shutterstock/i am Em You probably know some people around you, and maybe you are…

1 hour ago

Quebec remains competitive in the visual effects industry, assures Minister Girard

Photo: Jacques Boissinot The Canadian Press According to Minister Eric Girard, job losses in the…

5 hours ago