Safety3h ago
Safety
New VPD Method Decomposes Model Parameters
The adVersarial Parameter Decomposition (VPD) method now allows researchers to decompose attention layers, a known hurdle for SAEs and transcoders. This technique improves upon previous SPD and APD approaches. By building attribution graphs from causally important subcomponents, the team can interpret internal model logic. This makes parameter decomposition viable for larger, production-scale models.