Anthropic and Andon Labs develop drone control demonstration and evaluation

Anthropic and Andon Labs collaborate on Project Pilot, developing demonstrations and evaluations for assessing AI models' autonomous drone control. The task requires a drone to locate and track designated people indoors, and is split into five subtasks: reconstruction, localization, navigation, detection, and following, on which basis the benchmark Drone-Bench is built, with Andon Labs evaluating 15 models. The best performer is Claude Fable 5, which exceeds the human-AI team collaboration baseline on all subtasks except reconstruction, but because reconstruction errors accumulate in localization and navigation, it still cannot autonomously fly across rooms. Anthropic notes that the model capability frontier leads its stable performance by about six months, and Fable 5's current average level roughly corresponds to the one-off best performance of the previous-generation model in early 2026.

AI-generated from public reports

1. Jul 24· 1 reports

   Anthropic and Andon Labs develop drone control demonstration and evaluation

   Source:Anthropic：The Institute