Safety1d ago
Researchers Warn Of Societal Reward Hacking
Researchers from Kings College London and Fudan University argue that human societies are susceptible to reward hacking. They compare social systems to cyber environments where agents game rules for narrow gains. This suggests that misaligned AI could exploit societal incentives. Practitioners must account for these systemic vulnerabilities when designing reward functions for large-scale deployments.