←新闻详情

Aaron Levie更新于 10月21日 22:46

Box 实测 Claude Sonnet 5.5:整体提升 4 分,交付速度快 2.4 倍

At Box, we've been testing Sonnet 5.5 in early access on our complex work eval with the Box Agent, and Sonnet 5.5 is another strong jump from Sonnet 5 on knowle

AI 导读

Box 在早期访问中用 Box Agent 的复杂工作评测测试 Claude Sonnet 5.5,整体最难测试提升 4 分,完成交付物约快 2.4 倍且少用 12% token。分行业看,金融服务提升 18 个百分点、法律 7 个百分点、生命科学 8 个百分点、公共部门 7 个百分点;具体任务中尽职调查审查提升 48 分并快约 61%,商业租约审查提升 14 分,现场试验报告提升 22 分并快约 41%,数学干预项目报告提升 11 分并快约 71%。客户不久将能在 Box AI Studio 中用 Sonnet 5.5 构建 AI 智能体。

推荐理由

AI 评分 61

Box 用自家企业内容评测给出 Sonnet 5.5 相对 Sonnet 5 的量化提升,可看到模型在真实知识工作场景中的表现差异。

主题

标签

引用

Claude

@claudeai

Introducing Claude Sonnet 5.5, the second model in the Claude 5.5 family. It’s a clear upgrade over Sonnet 5, runs more than 30% faster, and costs up to 30% less for most work. https://t.co/UvXD8mDTF1

查看原帖

正文

当前显示原文,中文全文译文尚未就绪。

At Box, we've been testing Sonnet 5.5 in early access on our complex work eval with the Box Agent, and Sonnet 5.5 is another strong jump from Sonnet 5 on knowledge work with enterprise content.

Across the board we saw a 4 pt overall improvement on our hardest tests, but it was roughly 2.4× faster to a finished deliverable on 12% fewer tokens. We also saw major wins in key verticals, like a +18 percentage point improvement in Financial Services, +7 pt in Legal, +8 pt in Life Sciences, and +7 pt in the Public Sector.

Here are some specific wins on certain tasks that show the power of Sonnet 5.5:

* Financial services (+48 points): a due-diligence review of a trading-tool acquisition, where the deal book's arithmetic doesn't hold up. Sonnet 5.5 caught the miscalculated interest totals and the mispriced options and flagged them, and it also finished this work about 61% faster.

* Legal (+14 points): a commercial lease review. Sonnet 5.5 refused to invent a "standard" market benchmark for renewal terms and notice periods, and instead flagged what the lease was genuinely missing.

* Life sciences (+22 points): writing up a field trial from the raw measurement data. Sonnet 5.5 got the sample standard deviations right across both treatment groups. Sonnet 5 missed nearly all of them. And Sonnet 5.5 did it about 41% faster.

* Public sector (+11 points): a report on a math intervention program. Sonnet 5.5 pulled the right student progress-monitoring figures out of the underlying data, about 71% faster.

Customers will be able to build AI agents with Sonnet 5.5 in the Box AI Studio shortly.

来源

Aaron Levie