Safety
115d agoNew VPD Method Decomposes Model Parameters
The adVersarial Parameter Decomposition (VPD) method now allows researchers to decompose attention layers, a known hurdle for SAEs and transcoders. This technique improves upon previous SPD and APD approaches. By building attribution graphs from causally important subcomponents, the team can interpret internal model logic.
The Signal
This makes parameter decomposition viable for larger, production-scale models.