Overusing foundation models for tasks that do not require generative capabilities is a frequent engineering error. Chip Huyen warns that developers often treat LLMs as a universal tool, even for optimization problems. This tendency leads to inefficient architectures. Practitioners should prioritize deterministic logic over probabilistic models to ensure reliability and reduce unnecessary compute costs.