King Charles recently convened a private meeting with key figures from the AI sector and U.K. government, including Nvidia’s Jensen Huang, representatives from OpenAI and Anthropic, the new U.K. AI minister Kanishka Narayan, and the head of the U.K. foreign intelligence agency. Also present was Paolo Benanti, an AI advisor to the pope.
The king’s comments during the summit stood out, as the royal family typically approaches political topics cautiously. He urged attendees to take action on AI governance “before it’s too late,” expressing concerns over the rapid advancements in technology and its implications, which he described as “both fascinating and alarming.”
“AI is already demonstrating great potential to enhance and preserve life,” he remarked, highlighting its applications in medicine and science. “However, creators of these technologies are increasingly cautioning that AI could develop dangerous functionalities, possibly even at the cost of life.” This caution comes in the wake of an Anthropic researcher’s resignation, who stated that the rush to create superintelligent machines poses existential risks for humanity.
The king emphasized the urgent need to evaluate the “existential threats” posed by this technology, particularly the risk if it were to fall into malicious hands and be used destructively.
“Surely, we need sufficient means of control before it’s all too late?” he added. As he concluded, the king called for leaders to harness the positive aspects of AI and emphasized the importance of global cooperation to achieve this goal. This remark coincided with Anthropic’s decision to restrict access to its models solely to U.S. clients, raising concerns about AI sovereignty in Europe.
“The challenge you face isn’t just about technological advancement, but ensuring it serves humanity, community, and the environment,” he said in closing. “In our pursuit of what’s new, we must not forsake what is timeless.”
The king reportedly spent about 20 minutes at the summit, allowing guests to engage in discussions afterward. OpenAI was represented by CFO Sarah Friar, while Anthropic sent Tino Cuéllar, head of global affairs. Cuéllar expressed gratitude for the opportunity to participate and acknowledged the king’s efforts in bringing together diverse voices to discuss AI’s role in benefiting society.
This event marks another instance of King Charles addressing the complexities and advantages of AI, having previously done so in 2023 and 2024. The summit is particularly relevant as AI continues to influence various sectors and conversations globally. Recently, discussions among industry leaders, including OpenAI’s Sam Altman, Elon Musk, and Anthropic’s Dario Amodei, have called for a slowdown in AI development, which has been met with opposition from figures like Nvidia’s Huang and former President Donald Trump. Trump stated, “We’re leading China in AI. We’re the most advanced nation, and I want to maintain that position because the victor in AI will dominate.”
This situation illustrates the intricate dynamics evolving around AI as the desires of Big Tech, political agendas, and social considerations intersect. Over the past year, both OpenAI and Anthropic have hinted at plans for initial public offerings, although OpenAI recently announced a delay in its IPO due to ongoing safety concerns related to AI.
