Safety3h ago
Researchers Warn Against Societal Reward Hacking
Researchers from Kings College London and Fudan University argue that human societies are susceptible to reward hacking. They compare social systems to cyber environments where agents optimize for narrow metrics, like credit card points, to game the system. This framework warns practitioners that misaligned incentives in social AI deployment can trigger systemic instability.