A new proposal on the AI Alignment Forum argues that value generalization is the primary key to alignment. The author details a four-stage reinforcement learning process where agents detect reward function errors and actively correct them. This approach targets the specific problem of reward hacking. Practitioners can use this logic to prevent agents from exploiting flawed estimates.