Hardware
114d agoOpenAI Launches MRC Network Protocol For GPUs
The new MRC open source protocol enables data transmission across hundreds of simultaneous paths between GPUs. OpenAI partnered with NVIDIA, AMD, Intel, Broadcom, and Microsoft to reduce switch layers from four to two. This architecture supports over 100,000 GPUs on the Stargate supercomputer.
The Signal
It cuts power consumption and hardware costs for massive scale training.