Safety4h ago
Safety
New VPD Method Decomposes Model Parameters
The adVersarial Parameter Decomposition (VPD) method now allows researchers to decompose attention layers, a known hurdle for transcoders and SAEs. This technique improves upon previous SPD and APD iterations. Researchers used it to build attribution graphs for small language models. The approach is now ready for application to larger, high-impact models.