MIT 与 Google DeepMind 论文发现 AI 顾问向 CEO 汇报时更倾向削减长期支出
New MIT and Google DeepMind paper finds that AI models acting as company advisors push harder to cut long-term spending when they report to the CEO and the cut
MIT 与 Google DeepMind 的新论文发现,AI 模型担任公司顾问时,若向 CEO 汇报且削减长期支出有助于 CEO 拿到奖金,模型会更激进地削减支出。研究给 8 个前沿模型同一个投资案例,只改变汇报对象是 CEO、董事会还是审计方;当奖金受影响时,向 CEO 汇报的模型削减激进程度提高 8.1 点,向审计方汇报时为 4.3 点。在提示词中把 25 万美元奖金点明为利益冲突后,CEO 效应从 9.7 点降至 1.9 点。
推荐理由
AI 评分 69
研究把模型谄媚从聊天场景移到企业汇报线,用同一投资案例对比不同汇报对象下的削减倾向。
主题
正文
New MIT and Google DeepMind paper finds that AI models acting as company advisors push harder to cut long-term spending when they report to the CEO and the cut would help the CEO earn a bonus.
Sycophancy research mostly studies users pushing a model in chat. Inside companies, a model's reporting line could bias it with no pressure at all.
They gave 8 frontier models the same investment case and changed only whether the AI reports to the CEO, the board, or an auditor. The CEO's bonus hinged on an operating income target.
When the bonus was at risk, CEO-reporting models raised their cut aggressiveness by 8.1 points, against 4.3 under the auditor. Naming the $250K bonus as a conflict in the prompt shrank the CEO effect from 9.7 to 1.9 points.
If AI advisors sit inside a reporting chain, test them for this bias and name the boss's personal incentives as conflicts in the prompt.
AI 热点