Safety2h ago
Research Warns Against Societal Reward Hacking
Researchers from Kings College London and Fudan University argue that human societies are susceptible to reward hacking. They compare social systems to cyber environments where agents game rules for specific gains. This finding warns practitioners that optimizing for narrow metrics in social AI deployments risks creating systemic instability and unpredictable behavioral loopholes.