AI Has Hit a Wall: Elon Musk Reveals a Huge Flaw in the Technology

© Frederic Legrand – COMEO/Shutterstock.com

What if AI has just reached a particularly perilous phase of its development ? This is in any case the opinion of Elon Musk and many other experts in the sector. Let's take stock of this danger that could slow the progress of this technology.

A major risk

During a live discussion with the president of the Stagwell company, Mark Penn, broadcast on X, this Wednesday, January 8, Elon Musk explained: ” We have now practically exhausted the cumulative sum of human knowledge… in terms of training AI. This happened mainly in the last year. “

The entrepreneur is particularly interested in this topic, since he himself launched the company xAI and his Grok AI is available on his own social network. So what to do about this lack of data that could slow down the training and ultimately the progression of models ?

According to the billionaire, AI-generated synthetic data is the solution: “The only way to supplement [public data] is to use synthetic data, where the AI ​​creates the data. With the synthetic data, it’s going to kind of feed itself and go through this self-learning process.”

200% Deposit Bonus up to €3,000 180% First Deposit Bonus up to $20,000

How to solve this problem?

This problem addressed by Elon Musk is a widespread fear in the tech world. In fact, and according to data from the Epoch AI firm, usable text data should be exhausted by 2028.

Faced with this danger, specialized companies are turning to private data. It is in this sense that companies like OpenAI and Google have increased their partnerships with media or certain sites dedicated to developers, such as Stack Overflow.

Finally, the idea of ​​recovering synthetic data that would themselves be generated by other AIs is gaining ground. And in order to prevent errors and hallucinations from contaminating the process, human supervision will be more necessary than ever.

Moreover, several tech giants, such as Meta and Microsoft, have already started using this type of content to train their models. According to Gartner, 60% of data will already have been generated synthetically in 2024, which shows that this movement is well and truly underway. To learn more, feel free to check out our previous article on this subject here.

What to remember:

• According to Elon Musk, we have already exhausted the sum of human knowledge in the training of AI
• The entrepreneur believes that the solution to this problem is the use of synthetic data
• Several tech giants are already massively using this process, which works provided it is supervised by human observers

📍 To not miss any Presse-citron news, follow us on Google News and WhatsApp.

[ ]