AI Trends

OpenAI Astra for Law 6.2 Tops Harvey LAB-AA v1.1

Artificial AnalysisUpdated Nov 18 02:32

AI summary

OpenAI's Astra for Law 6.2 ranks first on the Harvey LAB-AA v1.1 legal benchmark with a 20.8% Hallucination-Gated All-Pass Rate, while GPT-6.2 Astra (max) places second at 15.0%. Astra for Law 6.2 is a specialized configuration of GPT-6.2 Astra, paired with an expanded legal retrieval index and instructions for research, weighing precedents, and drafting answers. The benchmark comprises 120 private tasks across 24 practice areas and penalizes model hallucinations in its primary metric.

Body

OpenAI leads Harvey LAB-AA v1.1 with Astra for Law 6.2, a specialized GPT-6.2 Astra configuration with an integrated legal search index

OpenAI describes Astra for Law 6.2 as a model configuration of GPT-6.2 Astra that pairs the model with an expanded legal search index and instructions for researching a question, weighing the authorities, and writing the answer.

Our implementation of Harvey’s LAB benchmark tests real-world legal work across 120 private tasks spanning 24 practice areas, penalizing hallucination in its headline metric, Hallucination-Gated All-Pass Rate. Astra for Law leads Harvey LAB-AA v1.1 with a score of 20.8%. GPT-6.2 Astra (max) comes in second with 15.0%.

Source

Artificial Analysis