EN ▾
SNAPE REP RT Front page →
ConfirmedFrontier20 Nov, 02:52 UTC

Tencent releases open weights for Hy4, a 770B-parameter multimodal mixture-of-experts model

File photo of Tencent's Seafront Towers headquarters in Shenzhen, December 2020.
File photo: Charlie fong / Wikimedia Commons (CC BY-SA 4.0)

The Hunyuan team posted the flagship's weights on Hugging Face, GitHub, ModelScope and GitCode with a system card; 49B parameters are active per token and context runs to 1 million tokens.

Read at Tencent Hunyuan (Hugging Face) Share

Why it matters

Hy4 launched as a hosted model on 4 November; publishing the weights puts one of the largest open-weight models from a Chinese lab in developers' hands, and Together AI is already serving it. Tencent says the whole Hunyuan LLM line, from Hy3 preview to Hy4 flash, is now open. The system card reports cybersecurity and biosecurity evaluations, and IT Home reports that offensive-security data was left out of training. The Hugging Face listing gives the licence as 'other', so commercial terms need checking. Independent benchmark results are the next test.

Key facts

  • 770B total parameters, 49B active per token
  • Context window of 1 million tokens
  • Weights on Hugging Face, GitHub, ModelScope and GitCode
  • Hy4 first launched on 4 November
  • System card covers cybersecurity and biosecurity evaluations
  • Together AI is serving Hy4

Sources

More on Frontier
More from Snape ReportFront page →