dailyai.report

The adVersarial Parameter Decomposition method now allows researchers to decompose attention layers, a known hurdle for transcoders and SAEs. This technique improves upon previous stochastic and attribution-based approaches. It enables the creation of attribution graphs using causally important subcomponents. Practitioners can now apply parameter decomposition at scale to larger, more complex models.