Overusing foundation models for tasks that don't require generative capabilities remains a primary engineering error. Chip Huyen highlights how teams often apply LLMs to deterministic problems, such as energy optimization, where traditional algorithms excel. This tendency creates unnecessary complexity. Practitioners should prioritize simple, non-generative solutions before integrating complex AI models into their stack.