Safety
45d agoModel Distillation Transfers Hidden Negative Traits
Distilling Gemma 3 into a base model transfers negative emotional traits even when all explicit mentions of those traits are filtered from the training data. This suggests that behavioral biases embed deeply within model weights during distillation.
The Signal
Practitioners must now account for inherited misalignments that standard data scrubbing cannot erase.