小米 MiMo-V2.5-Pro-UltraSpeed 发布,1T 模型解码突破 1000 tokens/s
小米与 TileRT 合作发布 MiMo-V2.5-Pro-UltraSpeed,首次在 1 万亿参数模型上把解码速度突破 1000 tokens/s,仅用单台标准 8 卡通用 GPU 节点实现。该 API 按申请制限时开放,价格为 MiMo-V2.5-Pro 的 3 倍、生成速度约 10 倍,试用窗口为 6 月 9 日至 6 月 23 日。团队对 MoE Experts 做 FP4 量化并采用 DFlash 块级掩码并行预测投机解码,编码场景平均接受长度 6.30,同时已在 Hugging Face 开源 MiMo-V2.5-Pro-FP4-DFlash 权重。

rrecting in the background — using raw speed to generate depth of thought, directly elevating reasoning quality. Second, it completely unleashes the productivity ceiling of Coding Agents. Before, having AI write code meant developers painfully waiting in front of screens, bottlenecked by inference latency. At 1000 tps, code generation speed and production efficiency undergo a paradigm-level acceleration. Most importantly, trillion-parameter models can now enter real-time decision loops. Millisec
匹配字段正文




