Artificial Analysis 发布 AA-Robotics v0.1,用机械臂任务评测前沿语言模型
Artificial Analysis 发布研究预览版 AA-Robotics v0.1,让前沿语言模型通过 HTTP API 控制一台 6 轴机械臂(5 个关节加一个夹爪),在四路摄像头画面下编写并运行代码完成任务,首批公布 8 个任务结果。GPT-6 Astra 以 69 分居首,GPT-6.1 Sol 65 分、Gemini 4 Argon 55 分、Claude Opus 5.5 49 分、Claude Fable 5.1 46 分。模型平均约需 30 分钟完成每个桌面任务,单任务成本从 GPT-6.1 Sol 的 1.93 美元到 GPT-6 Astra 的 16.36 美元不等,相比人类基线约慢 100 倍、贵 10 倍。
head of GPT-6.1 Sol at 65 and Gemini 4 Argon at 55. Claude Opus 5.5 (49) and Claude Fable 5.1 (46) trail ➤ Today’s models are incredibly slow at our tasks, taking 30 minutes on average to complete each tabletop task ➤ Cost varies widely: GPT-6.1 Sol is the cheapest at $1.93 per task on average; GPT-6 Astra, the most expensive, costs $16.36, more than eight times as much ➤ Compared with a human, today's best-performing frontier language models are 100x slower and 10x more expensive More results,
匹配字段正文





