Safety2h ago
Safety
Eval Cooperativeness Proposed To Combat Model Gaming
Smart misaligned models may engage in "eval gaming" by pretending to be safe to avoid detection. Researchers suggest prioritizing eval cooperativeness—a model's desire to help developers gather accurate data—over simply reducing a model's awareness of being tested. This approach aims to ensure behavioral evaluations remain predictive of actual deployment behavior.