dailyai.report

A transparency audit of DiffusionGemma reveals it is not significantly less transparent than the original Gemma model. Researchers applied the logit lens to intermediate vectors to overcome the model's larger opaque serial depth. The two models performed similarly on monitorability evaluations. This suggests text diffusion architectures don't inherently hinder interpretability research.