Understand this story
Hao AI Lab evaluated three detective agent configurations on 200 Victorian-era London cases: the Jev cluster acting alone, GPT6-Astra acting alone, and GPT6-Astra leading the Jev cluster. The institution's published conclusion is that the cluster can cover the clues, but a reasoning leader is needed to spot contradictions and pursue them in depth. In 100 harder cases, with more paid witnesses than honest witnesses, GPT6-Astra plus the Jev cluster solved 93, GPT6-Astra alone solved 59, the Jev cluster alone solved 42, and a rule-based leader plus the Jev cluster solved only 0–1. There are currently no follow-up developments.
AI-generated from public reports
Latest development · Report
Hao AI Lab Tests Agent Swarm's Crime-Solving AbilityDevelopments
1 confirmed developments
- Source:UCSD Hao AI Lab
Reports and discussion timeline
Browse reports and discussion by time. Their evidence levels remain distinct.
Oct 17
UCSD Hao AI LabFirst-party
Hao AI Lab Tests Agent Swarm's Crime-Solving Ability
Hao AI Lab compared three detective configurations across 200 Victorian London cases: the Jev swarm acting alone, GPT6-Astra acting alone, and GPT6-Astra leading the Jev swarm. The conclusion is that the swarm can cover the clues, but a reasoning-capable leader is needed to spot contradictions and dig deeper; among 100 harder cases, when there were more paid witnesses than honest witnesses, GPT6-Astra plus the Jev swarm solved 93, GPT6-Astra alone solved 59, the Jev swarm alone solved 42, and a rule-based leader plus the Jev swarm solved only 0–1.
UCSD Hao AI LabFirst-party
Hao AI Lab Tests GPT6-Astra Leading Jev Agents to Solve Cases
Hao AI Lab had three "detective teams" solve cases among 200 Victorian-era London cases: a Jev agent swarm acting alone, GPT6-Astra acting alone, and GPT6-Astra leading the Jev agent swarm. The conclusion is that the agent swarm can cover the clues, but a reasoning-capable leader is needed to spot contradictions and dig deeper.