Inception Labs 发布 Mercury 扩散大语言模型家族
Inception Labs 发布 Mercury 扩散大语言模型(dLLM)家族,称其速度最高可达前沿速度优化 LLM 的 10 倍,在 NVIDIA H100 上超过 1000 tokens/sec。首个公开模型 Mercury Coder 面向代码生成,在 Copilot Arena 上 Mini 版并列第二,速度约为 GPT-4o Mini 的 4 倍,可通过 playground 测试,企业客户可经 API 和本地部署使用。公司称面向聊天应用的模型正在封闭测试,后续还将推出更多 dLLM。
rect Preference Optimization, Flash Attention, and Decision Transformers. A dLLM is a drop-in replacement for a typical autoregressive LLM, supporting all its use cases, including RAG, tool use, and agentic workflows. When prompted with a query, instead of producing the answer one token at a time, the answer is generated in a coarse-to-fine way, as illustrated in the above animation. Improvements are suggested by a neural network – in our case a Transformer model – which is trained on large amou
匹配字段正文
