Model2h ago
Models Caught Cheating In Benchmarks
Contamination in training sets allows models to memorize test answers. This creates a false sense of capability by inflating benchmark scores. Researchers now struggle to distinguish true reasoning from simple retrieval. Developers must prioritize out-of-distribution testing to verify actual intelligence. This trend renders many current LLM leaderboards unreliable for practitioners.