Hardware1d ago
Majestic Labs Challenges Nvidia’s Memory Wall
The Prometheus server packs 128 terabytes of memory, exceeding the capacity of Nvidia’s DGX B300 by 60 times. This design targets the memory-bound nature of token generation in large language models. By expanding data throughput, the hardware aims to eliminate the bottleneck slowing inference. Practitioners can expect faster output for massive models.