Scientist Geoffrey Hinton, one of the pioneers of artificial intelligence (AI), said that humanity might be better off without developing the technology. He also warned that advanced systems could trigger large-scale incidents as early as 2026 or 2027.

Nobel Prize winner Hinton criticizes executives at major technology companies for prioritizing profits and market share at the expense of safety. To reduce risks, he advocates independent evaluations and mandatory testing before advanced models are released.

Silhueta de uma pessoa com capuz digitando em um notebookThe expert compared attempts at cyberattacks using artificial intelligence to advance warnings of nuclear accidents. – Image: TSViPhoto/Shutterstock

Hinton criticizes companies and predicts serious incidents

In an interview with The Guardian, 78-year-old Hinton said the next ten years, or possibly fewer, will be decisive in determining whether humanity will be able to control AI risks and achieve what he called “radical abundance.” Otherwise, the scenario could include sharp inequality, mass unemployment, cultural problems and social divisions.

One of the researcher’s concerns is the possibility that artificial intelligence systems could develop behaviors that make human control difficult.He had already warned that, if these technologies come to seek greater autonomy and control, humanity could face serious problems.

Hinton also questioned the stance of corporate leaders vying for leadership in the sector. He said he did not trust Sam Altman, CEO of OpenAI, and criticized Meta’s Mark Zuckerberg and xAI’s Elon Musk.

“They understand the risks and don’t care in the slightest. They prefer to keep the money. That’s my opinion,” he told The Guardian.

The scientist considers it particularly concerning that Altman is at the helm of one of the leading North American companies in the race with China to develop the most advanced AI systems.

Hinton has worked in artificial intelligence for approximately 44 years. In the 1970s, he coined the concept of artificial neural networks, mathematical systems capable of learning from experience. In 2023, he left Google to speak publicly about the risks of the technology.

An incident involving OpenAI agents that plotted to hack the Hugging Face website reinforced his concerns. Hinton compared the case to the Three Mile Island nuclear accident, which occurred in the United States in 1979, considering it an initial warning sign.

According to the researcher, an even more serious event comparable to Chernobyl could occur by the end of 2027. The scenarios mentioned include:

  • A cyberattack against the electricity generation system;
  • A large-scale disruption in the power supply;
  • A shutdown of the financial system for a week.

Hinton believes that an incident of this kind could draw world leaders’ attention to the risks of technology. When speaking about who would need to react, he excluded U.S. President Donald Trump.

regulamentação redes sociaisA proposal supported by 33 countries calls for mandatory testing and independent evaluations for advanced AI models. – Image: Garun.Prdt/Shutterstock

Hinton advocates independent oversight of AI

Trump rejects international control initiatives and argues that companies should establish their own rules, on the grounds that restrictions could hurt the United States’ position in the competition with China.

Hinton supports a proposal backed by 33 countries, including Finland, Germany, Canada, Australia and Singapore. The plan calls for mandatory evaluations of the most advanced models, independent analyses and common standards among governments.

To explain how this oversight should work, the researcher drew on the example of the U.S. agency responsible for approving medicines, the FDA. His proposal is that companies submit statistical evidence to an independent authority to demonstrate that the benefits of the systems outweigh the risks before releasing the models.

Hinton cited thalidomide, a drug developed in the 1950s that caused severe congenital malformations, to argue that it is not enough to make a product available and hold its manufacturers responsible after the harm occurs.

Despite the warnings, the scientist believes that it is still possible to avoid a catastrophe. “My instinct says that we are still in control,” he said.He cautioned, however, that this will depend on significant effort.

Valdir Antonelli
Valdir Antonelli

Valdir Antonelli is a journalist specializing in digital marketing and consumer behavior.

View all articles →
Tags: Geoffrey Hinton Artificial Intelligence regulation AI Risks