Safety3h ago
Safety
Quantization Effects on Gemma 3 Interpretability
Weight compression tests on Gemma 3 4B and 12B models reveal how 8-bit and 4-bit quantization alters model performance. This analysis tracks representational geometry changes across different compression levels. It provides a technical baseline for understanding how quantization affects feature activation. Practitioners can now better predict how weight reduction impacts model interpretability.