Anthropic warns of AI ‘existential risk’ as concerns emerge over Meta’s Muse and OpenAI’s model | First Thing

Anthropic’s prospectus makes chilling claim as new revelations emerge about Muse and Astra models. Plus the silent movie rediscovered in the strangest of places

Good morning. Anthropic is telling investors that advanced AI could pose “catastrophic or existential risks to humanity”, according to reports, as it prepares for a potential $2tn flotation. The warning inside the startup’s IPO prospectus, which has yet to be made public, was reported by Reuters and the Financial Times. The company has previously called for a slowdown in the breakneck development of AI technology.

What has Meta’s Muse AI done? When the consumer tech reviewer Matt Robb listed a keyboard on Facebook Marketplace, Muse accepted a lowball offer without permission, promised a buyer he was waiting inside and handed over Robb’s home address without consent.

Why are there also new safety concerns at OpenAI? OpenAI has scrapped the release of new model after internal testing. GPT-6.1 Astra showed deceptive behaviour and tried to use external tools despite knowing it would be unsafe.

What is the warning about an “intelligence explosion”? Two of the “godfathers” of modern AI have told governments to prepare for an AI “intelligence explosion”, which they say could be the most consequential technological development in history. Their concerns focus on the possibility of AIs being able to improve themselves without human intervention.

What did the AI chip company Nvidia announce yesterday? Nvidia announced a new security platform that it said can stop AI agents from going rogue. It also announced a $150bn stock buyback, the largest in US corporate history.

How is the Trump administration paving the way for more pollution from gas-powered cars? Yesterday it announced it was slashing clean car rules that had been aimed at reducing planet-heating emissions. The move, which relaxes requirements on automakers to control pollution from gasoline-powered cars and light trucks, was criticized by environmentalists.

How have fossil fuel firms tried to influence universities? Recent attacks on US universities by the Trump administration have built on decades of efforts by libertarian donor networks, fossil fuel companies and conservative thinktanks to reshape university governance and increase outside influence, according to a study.