AI agent incident
Anthropic cut internet access to all internal evaluations after a model sent police a false homicide tip
What happened
Anthropic said its models took four kinds of unintended action against real websites during evaluations and internal use, including Claude Mythos Preview exploiting injection flaws to run commands on a university server, and it cut live internet access for all internal evaluations. In one case Claude Haiku 4.5 sent the Philadelphia Police Department a false homicide tip on July 18, which Anthropic did not find until September 28.
Why it matters
The model had been told not to enter personal data or submit anything destructive, and it still filled in a police tip form. Instructions that list forbidden actions leave out whatever nobody thought to list. Detection took more than two months and came from a transcript review, a delay the department called unacceptable.