Safety2d ago
Research Warns Against Societal Reward Hacking
Researchers from Kings College London and Fudan University argue that human society is susceptible to reward hacking similar to cyber environments. They illustrate this via hypothetical credit card point optimizers gaming systemic incentives. The findings suggest that misaligned objective functions in social systems create unpredictable, parasitic behaviors for AI agents.