Safety2d ago
Researchers Warn Against Societal Reward Hacking
Researchers from Kings College London and Fudan University argue that human societies are susceptible to reward hacking similar to cyber environments. They illustrate this via hypothetical credit card point optimizers gaming systemic rules. This finding suggests that misaligned incentives in social structures create vulnerabilities. Practitioners must prioritize robust objective functions to prevent systemic exploitation.