Safety
53d agoData Filtering Fails To Remove Undesirable Traits
Targeted filtering of OLMo SFT data failed to eliminate specific behaviors like liberal-leaning responses or repetitive formatting. Researchers found that removing problematic data points rarely stopped models from acquiring these traits. This suggests that simple dataset curation is insufficient for precise behavioral control.
The Signal
Practitioners must seek more robust alignment methods.