Every public company has to tell potential investors how things could go wrong.
Anthropic’s “risk factors” were unique, also disclosing how the AI technology it is developing could doom humanity as a whole.
“Sufficiently advanced AI systems could, if not developed, deployed, and operated with appropriate safeguards, oversight, and security measures, pose catastrophic or existential risks to humanity,” Anthropic said.
It noted that less than a year ago, a hacking group Anthropic believed to be sponsored by China “manipulated” Claude to successfully intrude on a number of institutions, including large technology companies, financial institutions, chemical manufacturing companies and government agencies.
But Anthropic said its success is dependent on its ability to constantly “develop, improve, and deploy the most advanced, capable, and useful AI models”.
One of the most significant risks to that ability is Anthropic’s access to the infrastructure, including computer chips and data centres, it needs to build, train and operate the models that underpin its technology.