AI developer Anthropic plans to warn IPO investors that advanced artificial intelligence could pose 'catastrophic or existential risks to humanity,' according to reports, even as it pursues a valuation as high as $2 trillion.
Key facts
- Anthropic's IPO filing reportedly warns AI could pose 'catastrophic or existential risks to humanity.'
- The filing dedicates 80 pages to AI risks, nearly double the 48 pages on its business plans, according to Reuters.
- The company is eyeing a valuation of around $2 trillion.
- The preview also details mounting losses and leadership proposals to retain power, according to The Verge.
Anthropic, the artificial intelligence company behind the Claude chatbot, plans to warn potential IPO investors that advanced AI could pose “catastrophic or existential risks to humanity,” according to reports from Reuters cited by CNBC.
The unusual disclosure comes as the company prepares for a highly anticipated stock market debut. According to The Verge, a preview of the IPO filing details the company’s mounting losses, leadership proposals to retain power, and an acknowledgment that its AI development plans could “further increase the risk that our models cause harm.”
The scale of the warnings is notable. According to Reuters, Anthropic’s IPO filing dedicates 80 pages to the risks of AI, nearly double the 48 pages it spends discussing its business plans.
These disclosures come as Anthropic eyes a valuation of around $2 trillion, The Verge reported. That figure underscores the level of investor interest in the company despite the stark warnings contained in its own prospectus.
The combination of a large valuation target and blunt language about potential harms places Anthropic in an unusual position, effectively cautioning the very investors it is seeking to attract about the dangers of its core technology.
Why it matters
Anthropic is one of the leading companies in the AI industry, and its decision to prominently flag 'existential' risks in an IPO filing signals how seriously the sector is treating potential harms even as it pursues massive valuations. The disclosures give investors and the public a rare, formal accounting of the risks AI developers themselves foresee.
Frequently asked questions
What did Anthropic warn about in its IPO filing?
According to reports cited by CNBC and The Verge, Anthropic's filing warns that advanced AI could pose 'catastrophic or existential risks to humanity' and that its development plans could increase the risk its models cause harm.
How much of the filing focuses on AI risks?
According to Reuters, the filing dedicates 80 pages to AI risks, nearly double the 48 pages spent on the company's business plans.
What valuation is Anthropic targeting?
The Verge reported that Anthropic is eyeing a valuation of around $2 trillion.