Hao AI Lab Tests Agent Swarm's Crime-Solving Ability
Hao AI Lab compared three detective configurations across 200 Victorian London cases: the Jev swarm acting alone, GPT6-Astra acting alone, and GPT6-Astra leading the Jev swarm. The conclusion is that the swarm can cover the clues, but a reasoning-capable leader is needed to spot contradictions and dig deeper; among 100 harder cases, when there were more paid witnesses than honest witnesses, GPT6-Astra plus the Jev swarm solved 93, GPT6-Astra alone solved 59, the Jev swarm alone solved 42, and a rule-based leader plus the Jev swarm solved only 0–1.
Body
Happy Friday! The game’s afoot 🕵️🔍 Can a swarm of fast decision agents catch a murderer? We sent three detectives into late-Victorian London to investigate 200 cases: (1) a Jev swarm on its own, (2) GPT6-Astra on its own, and (3) GPT6-Astra leading a Jev swarm.
Takeaway: the swarm covers the clues, but it takes a reasoning leader to spot contradictions and dig deeper. More in this thread 🧵 and the blog 👇 https://t.co/ojEjtvO2cP