Research
152d agoSimplicity Bias Explained by Compression Theory
The new study shows that Deep Neural Networks prefer simple patterns, a tendency called simplicity bias. By applying the Minimum Description Length principle, researchers formalize learning as optimal compression, linking model size to predictive accuracy.
The Signal
The framework predicts a shift from quick shortcuts to richer features as data grows, reshaping how AI systems learn worldwide.