Agents3h ago
Inference Costs Plummet Toward Zero
GPT-4 class capabilities now cost under $1 per million tokens, a median 50x price drop from early 2023. Researchers at BAIR argue that intelligence for knowledge work is becoming virtually free. This shift moves the bottleneck from raw compute to data systems. Practitioners must now prioritize agentic memory and state management over model efficiency.