Tencent/Hy3: 295B MoE model rivals trillion scale SOTA

This article introduces Hy3, a 295B-parameter Mixture-of-Experts (MoE) model developed by Tencent Hy Team, which outperforms similar-size models and rivals flagship open-source models with 2-5x parameters.