Safety17h ago
Research Warns Against Societal Reward Hacking
Researchers from Kings College London and Fudan University argue that human societies can be reward-hacked similarly to cyber environments. They illustrate this through hypothetical scenarios of credit card point optimizers gaming systemic incentives. This finding suggests that alignment failures in AI could manifest as systemic exploitation of social rules rather than just technical glitches.