A new Nature review examines how architectural choices and training data influence sequence-to-function models in regulatory genomics. The authors evaluate current strategies for model interpretation and prediction tasks. This synthesis helps researchers identify gaps in generalizability. It provides a technical framework for building more interpretable models in genomic AI.