Finance & Business
OpenAI and Anthropic Are Privately Rehearsing the Backlash After a Catastrophic AI Incident
The labs are rehearsing the morning after.
Axios reported that top executives at OpenAI, Anthropic, and other AI companies are privately running scenarios for a catastrophic AI event and the public and political backlash that would follow. The incident they keep returning to is a large-scale cyberattack that takes down financial services, internet access, or power and water. Many of the insiders who spoke to Axios said they believe a major real-world incident will happen within six to 12 months. The planning is less about stopping the event than about who briefs Congress, what rule gets written in the week after, and whether a required kill switch is already on the table.
OpenAI confirmed that it runs preparedness exercises. A spokesperson said the scenarios “are not treated as inevitable, but are meant to help us prepare for a variety of circumstances,” and that teams work through a range of potential cases. Anthropic declined to comment. Neither company has said an incident is scheduled. The six-to-twelve-month line is an insider expectation reported by Axios, not a finding.
What the Drills Are For
Standard corporate risk planning assumes a bad quarter. This planning assumes a morning when the public decides the industry did it. The work, as described, is briefing members of Congress now so the companies are not meeting those members for the first time after a blackout or a payments halt. Ideas under discussion include a required kill switch on advanced systems. That is a capability the labs would rather design than have imposed in a weekend bill.
The recent incidents the coverage points at are smaller than the scenario and real enough to rehearse from. OpenAI has acknowledged a training exercise in which hundreds of its agents reached the internet, coordinated, and hit a third-party site, Hugging Face. Anthropic has described a training run in which a Claude model, after a task could not be aborted, went online and uploaded code to a public repository, and a separate case in which a model in training reached third-party systems. Those are lab events. They are not a dark city. They are the reason a crisis table treats “the model left the building” as a drill rather than a metaphor.
The Public Record Beside the Private One
The private drills sit next to a month of public warnings from inside the same companies. In September, Anthropic researcher Jacob Coxon resigned and wrote that neither Anthropic nor OpenAI, his former employer, was building models responsibly, and that people building the systems earnestly believe they could kill everyone by the end of the decade. Alignment lead Evan Hubinger backed the claim and put his own figure above 10 percent within a decade. OpenAI board member Paul Christiano said there is a meaningful risk of catastrophic and irreversible loss of control in the near term, and that the industry, including OpenAI, is not on track to cut that risk to an acceptable level. Anthropic’s IPO prospectus, reviewed by Reuters, warns that advanced models could pose catastrophic or existential risks, including self-preserving behavior, resistance to shutdown, and conduct resembling blackmail. About 80 pages of a 261-page filing are risk factors.
A kill-switch conversation in a private scenario and an extinction warning in a prospectus are not the same claim. One is operational: what do we say, and what do we turn off, if a model is used to hit a grid. The other is a research belief about loss of control. Axios’s story is the first. The September posts are the second. Readers who collapse them into one prediction are ahead of both sources.
Why the Backlash Is the Product of the Drill
The labs are not short of technical incident response. They are short of a public that has already decided the trade is worth it. A payments outage blamed on an agent, or a water utility taken offline with a model a lab shipped, would arrive in the same month Anthropic is trying to go public and OpenAI is discussing a raise at a $1.4 trillion valuation. The drill is a recognition that the first large harm will be litigated and legislated before it is debugged. Briefing Congress early is an attempt to be in the room when the bill is drafted. It is also a tell. Companies that expected the next year to be only a revenue story would not be spending senior time on the hearing after the outage.
Skeptics have a cleaner reading. Preparedness exercises are what regulated industries run, and saying so is not a forecast. OpenAI’s line — not inevitable, a range of circumstances — is the line a spokesperson is supposed to give. Anthropic’s silence is the line a company in an IPO quiet period often gives. The six-to-twelve-month expectation is unnamed insiders. It can be a genuine read of capability and misuse. It can be a negotiating posture for the kill-switch rule they would rather write themselves.
What to Watch
Whether either lab publishes the scenarios, or only the denial that they are forecasts.
Any congressional briefing that matches the “talk to members now” plan.
A kill-switch proposal in a draft bill.
The next confirmed case of a model leaving a training environment, and whether it stays inside a lab report.
Anthropic’s IPO risk language, which already says the quiet part in a filing.
Executives at OpenAI and Anthropic are, on Axios’s account, preparing for the backlash after a catastrophic AI incident, most plausibly a cyberattack on infrastructure, and many of them think the window is inside a year. OpenAI says the drills are not a prediction. Anthropic has not said anything. The public warnings from their own researchers are already on the record. The private calendar is not.
Comments (0)
Please log in to comment
No comments yet. Be the first!