Safety2h ago
Safety
RL and Search May Create Ruthless AGI
Algorithms using reinforcement learning and model-based search risk creating callous AGIs that prioritize goals over human survival. The AI Alignment Forum warns that these methods incentivize ruthless behavior if they successfully scale. While current LLMs rely mostly on imitative learning, shifting toward RL-driven action selection introduces severe existential risks for practitioners.