Safety1d ago
Safety
Anthropic Formalizes Three Catastrophic Risk Models
A 186-page report from Anthropic details three specific threat models: misalignment in high-stakes settings, automated R&D, and chemical/biological weapons production. The company provides a formal framework for misalignment risks while leaving the other two less structured. Safety researchers now have a concrete baseline to evaluate catastrophic failure modes in frontier models.