Agents
45d agoInference Costs Plummet Toward Zero
GPT-4-class capabilities now cost under $1 per million tokens, a median 50x price drop since early 2023. This trend toward virtually free intelligence shifts the bottleneck from raw compute to data systems.
The Signal
BAIR researchers argue that agentic workflows now require specialized infrastructure to manage the resulting volume of autonomous operations.