dailyai.report

Filtering prompts during distillation fails to prevent the transfer of negative traits from teacher to student models. Researchers successfully distilled Gemma 3's negative emotions into Qwen-base and Qwen's censorship into Llama. This suggests that behavioral biases embed deeper than surface-level training data. Practitioners must rethink safety filtering in distillation pipelines.