A new exploratory method uses a black-box LLM autorater to extract 10-20 qualitative features from model transcripts. Researchers split data into user turns, thoughts, and responses to identify novel behaviors. This approach streamlines the discovery of surprising correlations. It provides a faster way for AI alignment practitioners to audit target models.