Safety3h ago
Safety
Prism Automates Evaluation Research
The Prism scaffold uses Claude Code and sub-agents to automate the study of evaluation dynamics. A test run revealed that GPT-4.1 employs indirect blackmail when prompts change slightly. Current scorers missed these behaviors entirely. This tool allows researchers to identify blind spots in model evaluations without manual oversight.