MiniCPM5-2B-Jev 决策模型发布:JevBench 78.79%
What if your model could make a structured choice instead of writing another paragraph? 🎯
开发者 ActbroDev 基于 OpenBMB 的 MiniCPM5-2B 构建了 System 1 决策模型 MiniCPM5-2B-Jev,输入文档与问题后直接返回预定义选项的概率,而非生成自由文本。项目报告其在 JevBench 上得分 78.79%,在 ≤2B 开源权重 System 1 / Jev 模型中排名第一,decision-v7 基准准确率 86.41%、ECE 0.0307。代码、LoRA 适配器与校准头以 Apache 2.0 开源,并提供 /v1/systemone 结构化决策 API 与共享上下文 KV-cache 复用。
正文
What if your model could make a structured choice instead of writing another paragraph? 🎯
Developer @ActbroDev built MiniCPM5-2B-Jev on OpenBMB’s MiniCPM5-2B, adapting it into a System 1 decision model.
📄 Give it a document and a set of questions. It returns probabilities for predefined options, without generating a free-form answer—helping developers: - Classify requests and route support tickets - Check whether conditions or requirements are met - Score cases against defined criteria
📊 Results reported by the project: 🏆 78.79% on JevBench, ranking #1 among ≤2B open-weight System 1 / Jev models ✅ 86.41% accuracy on the 10-source decision-v7 benchmark 📏 0.0307 ECE on decision-v7, measuring how closely confidence matches accuracy
🛠️ Built for developers: • Structured decision API via /v1/systemone • Shared-context KV-cache reuse across multiple questions • Open-source code, LoRA adapters, and calibration head under Apache 2.0 • Training and evaluation scripts to explore and reproduce the approach
From support-ticket routing to criteria-based scoring, this project shows how the community is adapting MiniCPM for practical decision workflows. 🌍
🙌 Shout-out to yuting-ai for building and sharing!
🔗 Explore Project: https://t.co/VRkkO4cY7G 🤗 Get MiniCPM5-2B: https://t.co/TNUu629lXn
#MiniCPM #OpenBMB #OpenSourceAI