Safety
114d agoNew VPD Method Decomposes Model Parameters
The adVersarial Parameter Decomposition (VPD) method now allows researchers to decompose attention layers, a known hurdle for transcoders and SAEs. This technique improves upon previous SPD and APD iterations. Researchers used it to build attribution graphs for small language models.
The Signal
The approach is now ready for application to larger, high-impact models.