Hardware6h ago
Huawei HiFloat4 Outperforms MXFP4 On Ascend Chips
Huawei's HiFloat4 training format beat Western MXFP4 in performance tests on Ascend chips. This development follows strict US export controls on high-end silicon. The shift suggests Chinese firms are prioritizing custom numerical formats to bypass hardware limitations. Practitioners should monitor how these specialized formats affect model convergence and training efficiency.