AI 热点

Thomas Wolf 解释联署批评 Anthropic 声明的两点原因

Thomas Wolf更新于 11月19日 00:36

I'm featured quite visibly on Dan's letter, so it's probably good that I briefly explain why I signed while having friends at Anthropic and a lot of respect for

AI 导读

Thomas Wolf 表示,他虽不完全认同声明措辞,却因 Anthropic 的透明度和权力集中问题决定联署。他认为,Anthropic 日益扩大的影响力需要匹配更高程度的透明与开放;他还听到一些企业家、高管和研究人员因担忧职业发展或模型访问受影响而不敢公开表达关切。

推荐理由

AI 评分 60

Thomas Wolf 从透明度与权力集中两方面解释联署原因,也呈现业内人士担忧职业和模型访问受影响的现实压力。

主题

标签

引用

Dan Hendrycks

@hendrycks

许多人工智能安全组织私下告诉我们,它们赞同这一声明,却觉得如果签署,就可能危及现有关系或未来资金,因此无法署名。Anthropic 几乎控制了本应对其进行问责的整个生态系统,尽管尚未完全控制。

查看原文

Numerous AI safety groups told us privately they agreed with this statement, yet felt unable to sign without risking relationships or future funding. Anthropic has almost, but not entirely, captured the ecosystem meant to hold it accountable.

查看原帖

正文

I'm featured quite visibly on Dan's letter, so it's probably good that I briefly explain why I signed while having friends at Anthropic and a lot of respect for them in general.

I don't fully agree with the wording. I wouldn't have used "reckless", and I didn't know the name of the statement when I signed, which isn't my style. But I agree with the underlying sentiment and decided to sign for two reasons.

First, Anthropic is currently on track to be the most powerful company on earth (and for good reasons, like the quality of the team and product). This level of impact on the world will require a degree of transparency and openness close to, or maybe even higher than, that of a sovereign government, and I'm worried they are not currently on track to reach it. It's a version of "with great power comes great responsibility", applied to social responsibility toward everyone using and impacted by your products.

Second, Dan mentions safety groups who felt unable to sign. I heard the same thing directly from a different crowd: entrepreneurs, executives and researchers who agreed with the concerns but were afraid of consequences for their careers or their access to models. Whether or not that fear is justified, I think it's a first example of the problem above, and a worrying early signal about concentration of power in itself.

I'd genuinely like to be proven wrong on both points, and I think Anthropic has the people to do it.

来源

Thomas Wolf