←新闻详情

Arena更新于 10月13日 01:39

Jev Router 若入 Agent Arena 榜单:净提升 +3.6%,中位成本 $0.155

If Jev Router were on the Agent Arena leaderboard, it would post a +3.6% net improvement at a median cost of $0.155 per task.

AI 导读

Jev Router 若进入 Agent Arena 榜单,将录得 +3.6% 净提升,每任务中位成本 $0.155。它排名低于其最常路由到的 DeepSeek V4.1 Flash,但在 Steerability(+10.0% vs -0.2%)和 Praise vs Complaint(+6.3% vs +2.1%)上胜出;DeepSeek 则在 Confirmed Success(+8.3% vs +2.2%)、Bash Recovery(+7.8% vs -0.7%)和 Tool Hallucination(+0.4% vs +0.2%)上更强。其 Steerability 得分距 Claude Opus 5.5 (High) 仅低 0.48 个百分点。

正文

当前显示原文,中文全文译文尚未就绪。

If Jev Router were on the Agent Arena leaderboard, it would post a +3.6% net improvement at a median cost of $0.155 per task.

It would rank below DeepSeek V4.1 Flash, the model it routes to most, but beat it on Steerability (+10.0% vs -0.2%) and Praise vs Complaint (+6.3% vs +2.1%).

Where DeepSeek does better is on Confirmed Success (+8.3% vs +2.2%), Bash Recovery (+7.8% vs -0.7%) and Tool Hallucination (+0.4% vs +0.2%).

The key signal here is steerability - it demonstrates Jev’s strong capability to respond to user corrections. In fact, the router’s score is not far from that of Claude Opus 5.5 (High) - only 0.48 percentage points lower.

来源

Arena