←新闻详情

The Verge AI更新于 10月13日 12:45

OpenAI 安全员工 David Robinson 离职并公开警告

An OpenAI safety employee has quit and is sounding the alarm

AI 导读

曾为 OpenAI 每次重大模型发布撰写安全报告的 David Robinson 本周辞职,并在 The Atlantic 发表评论文章。他认为行业文化从根本上出了问题,不只是加几条训练模型的新规则就能解决,并称 AI 需要核级别的安全保障。此前 Jacob Coxon 从 Anthropic 离职并公开警告,随后 Google DeepMind 的 Robert O'Callahan、Bilal Chughtai、Josh Engels 以及 Anthropic 的 Joe Benton 也相继离开。

推荐理由

AI 评分 52

OpenAI 安全报告撰写者离职并公开批评行业文化,读者可借此了解头部 AI 公司安全人员的持续流失。

主题

标签

正文

当前显示原文,中文全文译文尚未就绪。

David Robinson used to write the safety reports that accompanied every major model release at OpenAI. This week, he resigned from his position and is now speaking out in an editorial in The Atlantic .

It’s understandable if you’re feeling a bit cynical about everyone suddenly coming out of the woodwork to warn about how dangerous the thing they helped build is. They did, after all, make this mess. But that doesn’t mean we should discount their warnings.

Robinson says that the culture in industry is fundamentally broken. That this is a deeper issue than simply slapping a few new rules or regulations on how we handle training models. Silicon Valley has operated with “extreme confidence” and “perpetual sprints,” he says, building bigger and better models with “unimpeded optimism” that ignores or underestimates potential problems.

He says the time has come for AI companies to develop a sense of humility and look outside the insular, move-fast-and-break-things world of the tech industry. Specifically, he says AI needs nuclear-level safeguards:

Robinson is just the latest in a growing parade of researchers and safety workers who have left their positions at prominent AI firms. Jacob Coxon seems to have kicked off the exodus by quitting Anthropic and then publicly saying AI “ could kill us all by the end of the decade .” He was followed by Robert O’Callahan , Bilal Chughtai, and Josh Engels at Google DeepMind, as well as Joe Benton at Anthropic.

来源

The Verge AI