Hardware4h ago
Huawei HiFloat4 Outperforms MXFP4 on Ascend Chips
Huawei's HiFloat4 training format outperformed Western MXFP4 in recent Ascend chip benchmarks. This development suggests US export controls are accelerating Chinese innovation in custom numerical formats. The shift optimizes hardware efficiency for large-scale training. Practitioners should monitor how these specialized formats impact model convergence and precision compared to industry standards.