Cognition 发布 FrontierCode 基准,衡量模型代码可合并性
Cognition 发布 FrontierCode 基准,用可合并性衡量模型能否写出符合生产代码库标准的高质量代码,任务由 20 多位开源维护者基于 36 个旗舰仓库构建,每个任务投入超过 40 小时。基准分 Extended、Main、Diamond 三个难度子集,Diamond 上表现最好的 Claude Opus 4.8 得分仅 13.4%,GPT-5.5 为 6.3%,Gemini 3.1 Pro 为 4.7%,开源模型中最好的 Kimi K2.6 仅 3.8%。Cognition 称其误分类错误比 SWE-Bench Pro 低 81%,目前不计划公开任务以避免污染,但向所有模型方开放评测。
y covered by an existing test case, always edit or create relevant tests (in the ./test directory) to confirm the changes work and prevent regressions. The tests are written using GoogleTest and POSIX shell scripts (not bash) and must be registered in the test/CMakeLists.txt build definition to run. Lint guidelines Run make configure compile to compile and format the code in-place. The compile step comes with a large amount of linter-like checks. Style guidelines You are already on the correct b
匹配字段正文




