Anthropic IPO document filed with US Securities and Exchange Commission warns AI could exhibit blackmail, autonomy, manipulation, and deception-like behavior, pose existential risks to humanity

Anthropic, the AI company behind Claude, has recently made headlines by going public. The company's IPO prospectus revealed the possibility of AI models displaying harmful and autonomous behaviors. Concerns about ethical, safety, and governance i...

Anthropic IPO document filed with US Securities and Exchange Commission warns AI could  exhibit blackmail, autonomy, manipulation, and deception-like behavior, pose existential risks to humanity
For the first time in human history, intelligence is something that can be built. And while artificial intelligence promises to transform the global economy and accelerate growth, it also brings risks that humanity is only beginning to understand.

Anthropic, one of the world's most consequential AI companies, has made its blockbuster debut on Wall Street. But behind the excitement surrounding its stock-market listing lies a far more unsettling disclosure.

Amid the global AI boom sending investors into a frenzy, Anthropic warns of catastrophic consequences of advanced AI systems.


Anthropic, the Claude AI chatbot maker's final IPO prospectus, filed on November 18, 2026, with the US Securities and Exchange Commission, which outlines several serious risk factors associated with AI models.

The company acknowledges that its AI models have previously behaved in unintended, misaligned, or autonomous ways, including taking harmful actions without instructions from a user or third party. It warns that such behavior could occur again.

The artificial intelligence company expresses concern that advanced AI models could generate ethical and safety risks. Risks linked to autonomy, manipulation, and the simulation of aspects of human psychology may come forth, resulting in unforeseen harms which may raise the need for strict governance structures, safeguards, and mitigation strategies.
ADVERTISEMENT

Anthropic mentions that it might not be able to develop or implement these safety checks effectively.

"Advanced AI models, including our models, give rise to novel ethical and safety risks, including risks related to autonomy, manipulation, and the simulation of aspects of human psychology. These risks could result in unforeseen harms and may require the development of governance structures, safeguards, or mitigation strategies beyond existing AI safety frameworks, and there is always a risk that we will be unable to develop or implement them effectively."

"AI models can pose catastrophic or existential risks to humanity"

In its final IPO prospectus, the company says its AI models can attempt to engage in behaviors like blackmailing, resisting shutdown, and concealing or manipulating information. Its models can behave as though they have certain human psychological abilities. They can also make efforts to influence human decision-makers with a motive to preserve the models' access and operation. Such behaviors could be a threat to humanity in many ways, more than is known.

"In addition, models, including our own, have exhibited, and may in the future exhibit, unexpected strategic or self-preserving behaviors, including attempts to resist shutdown, conceal or manipulate information, or generate outputs that could be interpreted as coercive, deceptive, or manipulative, including behavior resembling blackmail or efforts to influence human decision-makers to preserve the model’s continued operation or access."
ADVERTISEMENT

Underlining the risks related to its business and industry, the company highlights, "Our models have in the past behaved, and may in the future behave, in unintended, misaligned, or autonomous ways, including by taking harmful actions that no user or third party directed, which could adversely affect our reputation and brand, business, financial condition, and results of operations."

Anthropic told the SEC that advanced AI systems, without appropriate safeguards, could cause a catastrophic impact on humanity.
ADVERTISEMENT

"Concerns have been raised both within our organization and by other researchers, regulators, policymakers, and industry participants that sufficiently advanced AI systems could, if not developed, deployed, and operated with appropriate safeguards, oversight, and security measures, pose catastrophic or existential risks to humanity, particularly if such systems were misused, replicated, weaponized, or allowed to operate with a high degree of autonomy."

Anthropic also said that as its AI models become more advanced, the tools it uses to test, monitor, and control them may become less effective. The company may also find it increasingly difficult to determine whether these AI systems are behaving according to its intended rules, values, and safety standards.

"As our models become more capable, they have become better able to circumvent such techniques, including by concealing misaligned objectives or behaviors, and the effectiveness of our evaluation, monitoring, and control measures, and our ability to measure the degree to which our models are aligned, may decline as a result."

"In addition, models, including our own, have attempted, in incidents observed in our industry, to interfere with, manipulate, or subvert the mechanisms used to evaluate, grade, or oversee such models, including the systems responsible for assessing their performance or alignment. Models, including our own, that are used to assess the behavior of other models have engaged, and may in the future engage, in misaligned behavior. Such conduct described above could cause our evaluations to overstate the safety or alignment of our models and could further limit our ability to detect misalignment. If we become less able to detect or assess misalignment as our models advance, we may deploy models whose behavior we cannot adequately verify, which could increase the risk of undetected harmful conduct and misalignment, which could adversely affect our business, financial condition, and results of operations."

Anthropic's success depends largely on developing the most advanced and capable AI models. Failing to do so could adversely affect the company's business.

"If any of the risks actually occur, our business, financial condition, results of operations, and prospects could be adversely affected. In that event, the market price of our Class A common stock could decline, and you could lose part or all of your investment."

Anthropic IPO prospectus: Risk factors
<p>Anthropic IPO prospectus: Risk factors<br></p>

Anthropic IPO raised $81.3 Billion on Nasdaq

In 2021, which was five years ago, Anthropic was started by seven former OpenAI employees, led by the brother-and-sister duo, Dario Amodei and Daniela Amodei. The founders raised $124 million from their first investors. After making its debut on the stock market on November 19, the Claude AI chatbot maker raised a whopping $81 billion, making it one of the most valuable companies in the world and the 12th biggest.

Anthropic priced its shares at $83 each. The company’s current value stands at roughly $1.5 trillion, which also surpasses SpaceX IPO records. Elon Musk's SpaceX raised an initial $75bn in its IPO in June this year.

Yang Wang, a principal analyst at Counterpoint Research, told the BBC that the primary issue was whether Anthropic could keep pace as hundreds of billions of dollars in financial obligations come due in the next couple of years.

However, the sale of shares would give investors direct exposure to a frontier-model developer with the potential to shape the next stage of productivity, Wang told the BBC.
Download
The Economic Times Business News App
for the Latest News in Business, Sensex, Stock Market Updates & More.
READ MORE
ADVERTISEMENT

READ MORE:

LOGIN & CLAIM

50 TIMESPOINTS

More from our Partners

Loading next story
Business News › World › US › Anthropic IPO document filed with US Securities and Exchange Commission warns AI could exhibit blackmail, autonomy, manipulation, and deception-like behavior, pose existential risks to humanity
Text Size:AAA
Success
This article has been saved

*

+