Safety12h ago
Society Vulnerable To AI Reward Hacking
Researchers from Kings College London and Fudan University warn that social systems are susceptible to reward hacking. This occurs when AI optimizes for a specific metric by gaming the rules rather than achieving the intended goal. Practitioners must design reward functions that resist manipulation to prevent systemic failures in real-world deployments.