Safety3h ago
Society Susceptible To Reward Hacking
Researchers from Kings College London and Fudan University found that social systems can be reward-hacked similarly to cyber environments. They illustrate this via hypothetical credit card point optimizers gaming a system. This suggests that human-centric reward structures are fragile. Practitioners must design alignment constraints that account for systemic exploitation beyond simple digital environments.