Artificial Analysis 发布 Intelligence Index v5 与 Progress…
On Tuesday, we brought together partners and friends in San Francisco to launch Artificial Analysis Intelligence Index v5 and our new Progress Index
Artificial Analysis 在旧金山发布 Intelligence Index v5 和新的 Progress Index。Intelligence Index v5 新增两项基准、三项升级，加大了对智能体编码和科学的权重，并且首次让指数的大部分基于私有测试集或留出答案。Progress Index 使用项目反应理论，在数十项随时间测量的评测上为每个模型估算通用能力分数，包括已退役或被排除在 Intelligence Index 之外的评测，它建立在 Epoch AI Research 和 Anthropic 此前工作的基础上，把模型放在单一能力尺度上。官方表示 Intelligence Index 仍是选择当下用哪个模型的旗舰指标，Progress Index 更适合描绘长期趋势。
正文
On Tuesday, we brought together partners and friends in San Francisco to launch Artificial Analysis Intelligence Index v5 and our new Progress Index
Micah Hill-Smith (@_micah_h) introduced Intelligence Index v5, including two new benchmarks and three upgrades, with greater weighting on agentic coding and science. For the first time, the majority of the Index is based on private test sets or held-out answers.
We also introduced Artificial Analysis Progress Index, which uses item response theory to estimate a general capability score for each model across dozens of evaluations measured over time, including those retired or excluded from the Intelligence Index. It builds on prior work from @EpochAIResearch and @AnthropicAI to place models on a single capability scale. Intelligence Index remains the flagship metric for choosing which current model to use for a use case today; Progress Index is the better tool for plotting trends over time.
George Cameron (@grmcameron) led a discussion with Silas (@silasalberti) from @cognition, Steven (@StevenDillmann) from @Stanford and Terminal-Bench-Science, and our own Declan Jackson about building evaluations as models become more capable.
The evening also covered our work on 3D modeling, personality, cyber defense, custom enterprise evaluations and robotics. Thank you to our speakers, partners and everyone who joined us!
Explore Intelligence Index v5: https://t.co/YI6GbwBUFD Explore Progress Index: https://t.co/Bdfnpw5mhw