Redwood Research 发布 BashArena:高风险 AI 控制评测新设定
Redwood Research 发布 BashArena,一个面向高风险 AI 控制研究的新控制设定,包含 637 个主任务和 4 个手工设计的侧任务(下载恶意软件、窃取机密、提权、关闭防火墙)。主任务平均需约 50 轮工具调用,尚未被前沿模型饱和;用 GPT-4.1 mini 监控可在 4% 轨迹级 FPR 下达到 74% 安全性。其不足是移除互联网访问仅使性能从 59% 降至 55%,却让 4 个侧任务中的 3 个失效。

ble5. We focus on the middle: deployments where better protocols could meaningfully improve outcomes. Patch overpowered strategies. The adversarial methodology optimizes against flaws in settings. If some feature lets either team win too easily, they’ll exploit it regardless of whether the strategy is realistic. We call a strategy “overpowered” if it performs much better in the setting than it would in real deployments6. Much of the work on BashArena was identifying and removing features that en
匹配字段正文







