A new exploratory method uses a black-box LLM autorater to extract 10-20 qualitative features from model transcripts. By splitting data into user turns, thoughts, and responses, researchers identify novel behaviors and surprising correlations. This approach streamlines how AI Alignment Forum contributors analyze target model distributions. It simplifies the search for hidden behavioral triggers.