←新闻详情

腾讯混元更新于 10月14日 22:32

腾讯混元 Hy4 preview 自主发现推理瓶颈

One more thing about Hy4 preview that is particularly interesting.

AI 导读

关于 Hy4 preview 还有一件特别有意思的事。 在 AI 研究中,Hy4 preview 自主发现了推理瓶颈,并通过算子融合与通信优化将端到端吞吐量提升 31.8%——在不同上下文长度和并发下保持稳定。 更多内容:https://t.co/MXVjtIFxeh

引用

Tencent Hy

@TencentHunyuan

🚀 Hy4 preview is here. 770B, 49B active, 1M context. Built for productivity. Open source frontier. Consistent affordable price. Use it. Tell us what breaks. More on Hy blog:https://t.co/rbl1IWRk3C HuggingFace:https://t.co/mE9wevH5XR Github:https://t.co/pyl9zckpoL https://t.co/4iW6gSuZKr

查看原帖

正文

当前显示原文,中文全文译文尚未就绪。

One more thing about Hy4 preview that is particularly interesting. In AI research. Hy4 preview found inference bottlenecks on its own and lifted e2e throughput 31.8% via operator fusion and comms opts — stable across context lengths and concurrency. MORE ON: https://t.co/MXVjtIFxeh

来源

腾讯混元