Agents
52d agoInference Costs Plummet Toward Zero
GPT-4 class capabilities dropped from $30 per million tokens in early 2023 to under $1 today. This median 50x price decline, highlighted by BAIR, makes high-level intelligence virtually free. The shift moves the bottleneck from raw model cost to data system architecture.
The Signal
Developers must now prioritize how AI agents manage state and memory.