Unsloth:Qwen3.8-Flash 本地提速 1.7 倍
Qwen3.8-Flash can now run 1.7× faster locally with MTP!⚡️
AI 导读
Qwen3.8-Flash 现在借助 MTP 在本地运行速度提升 1.7 倍!⚡️ GGUF 在 RTX PRO 6000 上可达 170 tokens/s。 MTP 让 Qwen3.8-Flash-Next 推理速度提升约 1.3–1.7 倍,且精度不变。
查看原帖Qwen3.8-Flash can now be run locally! 🔥 The 125B MoE model outperforms Claude-Opus-4.6 (Max). Run on 75GB RAM via Unsloth GGUFs. Qwen3.8-Flash-Next enables CPU RAM / unified mem setups to deliver near VRAM speeds. Guide: https://t.co/LLMclyJTeL GGUF: https://t.co/vXkjO3W0fj https://t.co/sPs8C2RJQw
正文
当前显示原文,中文全文译文尚未就绪。
Qwen3.8-Flash can now run 1.7× faster locally with MTP!⚡️
GGUFs can reach 170 tokens/s on a RTX PRO 6000.
MTP enables Qwen3.8-Flash-Next ~1.3–1.7× faster inference with no accuracy change.