Agents3h ago
Inference Costs Plummet Toward Zero
GPT-4 class capabilities now cost under $1 per million tokens, down from $30 in early 2023. This 50x median price decline shifts the bottleneck from raw intelligence to data systems. Researchers at BAIR argue that virtually free intelligence necessitates new architectures. Practitioners must now prioritize agentic data infrastructure over model optimization.