Safety21h ago
Safety
Reevaluating Deep Learning Theory
A LessWrong author revised their skepticism regarding the paper “There Will Be a Scientific Theory of Deep Learning”. After reviewing Zhang et al. 2016 and Nagarajan et al. 2019, they found infinite width/depth-limit work more compelling than previously judged. This shift suggests a renewed interest in formalizing the theoretical foundations of neural networks.