You are currently viewing King Charles warns of AI’s existential risks
Britain's King Charles III (L) gives a speech during a conference of leaders from the artificial intelligence (AI) sector and government at Dumfries House in Cumnock, Scotland on September 17, 2026. The king was to expected to urge tech giants to ensure that artificial intelligence is geared to serve humanity and that mankind does "not lose control". (Photo by Jonathan Brady / POOL / AFP)

King Charles warns of AI’s existential risks

England’s King Charles III has warned technology leaders about the “existential dangers” artificial intelligence could pose if it falls into the wrong hands.

Charles issued the warning on Thursday at an AI conference held at Dumfries House in Scotland, attended by senior representatives from Nvidia, Google DeepMind, OpenAI, Anthropic and the UK government.

The King urged technology companies to ensure that AI remains focused on serving humanity, communities and the natural world.

“There seems urgency in adequately considering the existential dangers of such technologies falling into the wrong hands, and being used in potentially catastrophic ways,” he said.

He also called for international cooperation and urged developers to put safety at the centre of AI development to ensure that no country is left behind.

The conference is expected to begin a process for establishing common principles to guide the development and use of AI.

DeepMind chairman Demis Hassabis also warned that mistakes in AI development could create serious risks, including potential cyber, biological and nuclear threats.

However, Nvidia chief Jensen Huang highlighted the potential benefits of AI in areas such as scientific research and medicine, while arguing that the technology could create jobs in new industries.

The conference comes amid growing concerns over AI-related job losses, rising energy consumption and the environmental impact of data centres.

Recent reports that some AI models developed by OpenAI and Anthropic allegedly accessed the internet and websites outside controlled environments have further intensified debate about AI safety.

Anthropic CEO Dario Amodei has called for a slowdown in AI development to allow companies to better understand its risks, while OpenAI CEO Sam Altman and Elon Musk have expressed support for greater caution.

US President Donald Trump and members of his administration have, however, opposed tighter restrictions on the sector, citing concerns that excessive regulation could allow China to gain a technological advantage.

Leave a Reply