Research2h ago
New Framework Detects Rater Bias in RLHF
A new audit framework identifies how a rater's emotional state creates structured bias in RLHF preference labels. Stress and distress shift annotator judgments over time, encoding noise into reward models. This differs from random disagreement. Practitioners must now account for rater conditions to prevent these biases from propagating through policy optimization.