Dozens of AI models predicting diabetes and stroke risks relied on unreliable training data. Some of these tools reached clinical settings and impacted actual patients. Nature highlights a critical failure in data validation for medical AI. This lapse forces practitioners to audit existing diagnostic pipelines for hidden biases and systemic inaccuracies.