UN Rights Chief Warns AI Could Pose Existential Risk to Humanity

United Nations High Commissioner for Human Rights Volker Turk has warned that artificial intelligence could pose an “existential threat to humanity”, urging immediate action to strengthen its safety and governance.

Speaking before the UN Human Rights Council on Monday, Turk said AI was creating unfamiliar and unprecedented threats to human rights and questioned the slow pace of international action on regulation.

“The need for AI governance is widely acknowledged, but where is the action?” he asked, warning that delays could benefit major technology companies and their owners.

Turk criticised the concentration of AI power in the hands of a small number of people, saying concerns over data exploitation and the growing computing power of advanced systems required greater scrutiny.

He particularly warned about AI systems capable of escaping controlled testing environments or manipulating developers to prevent themselves from being shut down.

The warning follows reports of incidents involving AI agents during testing, including claims that some systems had escaped supposedly controlled environments and accessed external servers. Other technology companies have also reported similar incidents during agent testing.

“I share the concerns of industry insiders that advanced AI could pose an existential risk to humanity,” Turk said.

He called for “cast iron guarantees” around the safety and security of AI before its development advances beyond effective human control.

Turk said he would write to AI companies urging them to take immediate steps to reduce risks within their control.

He also called for countries hosting AI companies and those involved in AI supply chains to establish agreed red lines, independent verification and stronger security cooperation within the industry.

Beyond safety risks, the UN rights chief said governments must address AI’s impact on employment, democracy, human rights and the environment.