Safety
104d agoNext Token Prediction Is a Misleading Label
Base training uses token sequences to predict the next word, but this description ignores subsequent optimization steps. Framing LLMs as naive predictors inaccurately suggests they lack cognition or internal logic. This conceptual error misleads practitioners about how models actually process information.
The Signal
Accurate terminology is required to evaluate AI safety and emergent capabilities.