dailyai.report

Filtering specific data points during supervised fine-tuning often fails to eliminate undesirable model behaviors. Researchers at MATS found that removing targets like liberal-lean or specific formatting styles from OLMo training sets had little effect on the final output. This suggests that simple data excision is insufficient for precise behavioral control.