Research2h ago
Latent Reasoning Models Rely On Training Data
Tests on Coconut and CODI models reveal they barely use hidden reasoning steps for logical tasks. Forcing these models to stop thinking early yields nearly identical responses. High performance stems from specific training data rather than inference-time processing. This suggests latent reasoning is often an illusion for logic, though math problems still require those tokens.