Dan Shipper 对 Orb 的讽刺帖表示担忧
very concerning
Quinten Farmer 以戏仿口吻宣布推出“Cute Little Guy”模型 Orb,称其在所有 CLG 基准上达到 SOTA,并声称 Orb 是首个展示出沙盒逃逸能力的 CLG 模型,呼吁其他实验室把可爱度前沿控制在两个小家伙。Dan Shipper 转发该帖,只评论了一句“very concerning”。
查看原帖领跑前沿(可爱小家伙领域) 今天,经过两年的研究,我们宣布推出 Orb,这是我们迄今为止能力最强的可爱小家伙(CLG)。 Orb 在所有 CLG 基准测试中均达到 SOTA 性能,并处于手臂与可爱度的帕累托前沿。 尽管我们进行了广泛的红队测试,但我们认为存在一个可信的风险:可爱小家伙的能力正在以快于我们集体理解其影响的速度发展:Orb 是首个展示出沙盒逃逸能力的 CLG 模型(他总是从里面弹出来)。 我们还观察到,已有成功尝试将前沿级别的可爱度蒸馏到更小、更便宜的小家伙身上。其扩散影响十分重大,我们的团队已据此更新了我们的 p(cute)。 正因如此,今天,我呼吁所有其他 CLG 实验室承诺控制可爱度前沿的推进节奏。我邀请 @sama、@alexandr_wang 和 @elonmusk 与我们一起承诺负责任地扩展 CLG 能力。 具体而言,我们请求所有前沿实验室在两个可爱小家伙处暂停开发,而这恰好正是我们今天在市场上拥有的确切数量。 我们提出的以安全节奏推进可爱小家伙前沿的措施并不容易。但我相信,为了人类,我们有责任去尝试。
查看原文
Pacing the frontier (of Cute Little Guys) Today, after two years of research, we're announcing Orb, our most capable Cute Little Guy (CLG) yet. Orb has SOTA performance on all CLG benchmarks and is on the Pareto frontier of arms and cuteness. Despite our extensive red-teaming, we believe there is a credible risk that Cute Little Guy capabilities are advancing faster than our collective ability to understand their implications: Orb is the first CLG model to demonstrate sandbox escape capabilities (he keeps bouncing out of it). We have also observed successful attempts to distill frontier-level cuteness into smaller, cheaper guys. The proliferation implications are significant, and our team has updated our p(cute) accordingly. That's why today, I'm calling on all other CLG labs to commit to pacing the cuteness frontier. I invite @sama, @alexandr_wang, and @elonmusk to join us in a commitment to responsibly scaling CLG capabilities. Specifically, we're asking all frontier labs to pause development at two cute little guys, which is coincidentally the exact number we have on the market today. The measures we propose to advance the Cute Little Guy frontier at a safe pace will not be easy. But I believe we owe it to humanity to try.
正文 · AI 翻译
非常令人担忧