AI 热点

OpenAI Astra for Law 6.2 登顶 Harvey LAB-AA v1.1

Artificial Analysis更新于 11月18日 02:32

OpenAI leads Harvey LAB-AA v1.1 with Astra for Law 6.2, a specialized GPT-6.2 Astra configuration with an integrated legal search index

AI 导读

OpenAI 的 Astra for Law 6.2 在 Harvey LAB-AA v1.1 法律基准上以 20.8% 的 Hallucination-Gated All-Pass Rate 排名第一,GPT-6.2 Astra (max) 以 15.0% 位居第二。Astra for Law 6.2 是 GPT-6.2 Astra 的专用配置,搭配扩展的法律检索索引与研究、权衡判例、撰写答案的指令。该基准包含 24 个执业领域的 120 项私有任务,并在主指标中对模型幻觉进行惩罚。

正文

OpenAI leads Harvey LAB-AA v1.1 with Astra for Law 6.2, a specialized GPT-6.2 Astra configuration with an integrated legal search index

OpenAI describes Astra for Law 6.2 as a model configuration of GPT-6.2 Astra that pairs the model with an expanded legal search index and instructions for researching a question, weighing the authorities, and writing the answer.

Our implementation of Harvey’s LAB benchmark tests real-world legal work across 120 private tasks spanning 24 practice areas, penalizing hallucination in its headline metric, Hallucination-Gated All-Pass Rate. Astra for Law leads Harvey LAB-AA v1.1 with a score of 20.8%. GPT-6.2 Astra (max) comes in second with 15.0%.

来源

Artificial Analysis