Research
21d agoTencent Releases Hy4 Preview MoE Model
Tencent released Hy4 Preview, an open-weight model featuring 770B total parameters and 49B active parameters. It expands the previous Hy3's context window to 1M tokens. The model's chat template includes a specific reasoning_effort toggle for high-intensity thinking.
The Signal
This scale increase provides a massive new baseline for researchers testing large-scale mixture-of-experts architectures.