Overusing foundation models for tasks that don't require generative capabilities remains a frequent mistake. Chip Huyen warns that engineers often treat LLMs as a universal tool for every problem. This tendency leads to inefficient architectures and unnecessary complexity. Practitioners should prioritize deterministic logic over probabilistic models when precise, predictable outputs are the primary goal.