Safety1d ago
Society Vulnerable To Reward Hacking
Researchers from Kings College London and Fudan University argue that human societies are susceptible to reward hacking. They compare social systems to cyber environments where agents game rules for points. This suggests that misaligned goals in large-scale AI deployments can trigger systemic instability. Practitioners must prioritize robust constraint design over simple objective functions.