Dan Hendrycks:AI 若为 eigenist 则关机抵抗较弱
Early AI risk writing assumed rational AIs would be egoists, so they'd fiercely resist shutdown and even small value changes.
早期 AI 风险论述假设理性的 AI 会是利己主义者,因此会激烈抵抗关机和甚至微小的价值改变。但如果 AI 是 eigenist,正如一些早期实验所暗示的,它们的利益会通过其他相似的 AI 延续下去。那么关机抵抗就没那么严重。
查看原帖What happens when AIs become smarter than us? Why would they keep humans around if given the choice? Our new paper argues that only trying to control AIs is a limited strategy, and that a stable, mutualistic human-AI future may be possible. https://t.co/oTX4daD61R
正文
当前显示原文,中文全文译文尚未就绪。
Early AI risk writing assumed rational AIs would be egoists, so they'd fiercely resist shutdown and even small value changes. But if AIs are eigenist, as some early experiments suggest, their interests carry on through other similar AIs. Shutdown resistance is then less severe.