A new exploratory project uses black-box LLMs to identify 10-20 qualitative features within model transcripts. The process splits data into user turns, thoughts, and responses to uncover hidden correlations. This automated rating method helps researchers find novel behaviors in deployment distributions. It simplifies how AI alignment teams audit complex model trajectories.