Research3h ago
Recall Bottleneck Limits Parametric Factuality
A new Google AI Research study identifies recall failure as the primary cause of hallucinations in parametric memory. The researchers found that models often possess the correct knowledge but fail to retrieve it during generation. This distinction separates knowledge gaps from retrieval errors. Practitioners should prioritize decoding strategies over further pre-training to fix these factual slips.