Safety3h ago
Safety
Analysis of Neural Computation in Superposition
A recent InkHaven lightning talk breaks down the theoretical complexities of neural superposition. The author simplifies dense computer science mathematics to explain how models store more features than they have dimensions. This interpretation helps researchers understand model internals. It clarifies the specific trade-offs between feature interference and computational efficiency for alignment practitioners.