A new paper by Simon et al. challenges the prevailing pessimism regarding the theoretical foundations of neural networks. While most researchers view deep learning as an empirical black box, the authors argue a formal scientific theory is inevitable. This perspective shifts the focus toward long-term interpretability for AI safety practitioners.