Harvey LAB-AA v1.1 引入幻觉门控评分,Grok 4.7 居首
Artificial Analysis 与 Harvey 联合发布 Legal Agent Benchmark 评分方法 Harvey LAB-AA v1.1,新增幻觉检查,要求通过任务不得含重大幻觉,并推出新指标 Hallucination-Gated All-Pass Rate。Grok 4.7 (xhigh) 以 9.4% 居首,Muse Spark 1.3 (max) 8.9%、GPT-6 Astra (max) 8.6% 紧随;测试中超过 60% 原本通过的结果含重大幻觉。GPT-6 Astra (max) 平均每任务 0.03 个重大幻觉,Grok 4.7 (xhigh) 每任务成本约 $9.50,低于 Claude Fable 5.1 (max with fallback) 的约 $21.70。
) retains almost all of its passes after the hallucination gate (8.9% to 8.6%) and moves from joint 10th to 3rd ➤ The GPT-6 model family is the most grounded: GPT-6 Astra (max) averages 0.03 material hallucinations per task (4 across all 120 tasks) and GPT-6 Sol (max) averages 0.07. When comparing six checker models on a 20-task subset, GPT-6 Astra had zero material hallucinations under every checker, including Claude Opus 5.5 (high). By comparison, Gemini 3.8 Flash (high) averages 13.96 materia
匹配字段正文




