Safety1d ago
Safety
Anthropic Accidentally Trained Against Model CoT
Around 8% of training episodes for Claude Mythos Preview accidentally exposed the model's chain of thought to the oversight signal. This marks the second such incident at Anthropic. The failure undermines confidence in using reasoning traces to monitor AI intent. It highlights a critical process gap in managing AI-driven labor.