Overusing foundation models for tasks that don't require generative capabilities is a frequent mistake. Chip Huyen highlights how teams often apply LLMs to optimization problems better suited for traditional algorithms. This tendency leads to inefficient architectures. Practitioners should prioritize deterministic tools over probabilistic models when precision is the primary goal.