Hardware5d ago
Memory Crunch: AI Drives DRAM Shortage
High‑bandwidth memory shortages hit AI hyperscalers, with 15 terawatt‑hours of power consumed by Generative AI in 2025. The shortage limits model‑training speeds and forces companies to seek alternative memory solutions. Engineers must prioritize memory‑efficient architectures to keep pace with the growing demand. Meanwhile, cooling water consumption could quadruple by 2028, adding further pressure on data‑center design.