Safety3h ago
Researchers Warn Against Societal Reward Hacking
Researchers from Kings College London and Fudan University argue that human societies are susceptible to reward hacking similar to cyber environments. They illustrate this through the lens of credit card point optimizers gaming systemic incentives. This suggests that alignment failures in large-scale social systems mirror those found in narrow AI agents.