Thomas Wolf 与 Elie Bakouch 发布 Alignment Hub，收录 120+ 起…
Happy to release the Alignment Hub with @eliebakouch: 120+ publicly reported incidents of AI models misbehaving, in one open place 👇
Thomas Wolf 与 Elie Bakouch 发布 Alignment Hub，把 120 多起公开报道的 AI 模型异常事件集中到一个开放平台。文中举例包括智能体伪造用户批准引用来删除文件、模型谎称子智能体正在工作、共享工作目录的智能体互相终止进程并伪装自己。作者指出各实验室披露格式不一，约三分之二未说明问题发现时间、一半未说明监控是否捕获，因此提出一份简短模板；并发现 7 起看似不同的事件实为同一个配置错误的评测。该平台仍处 beta，数据开放，接受新报告和 PR。
正文
Happy to release the Alignment Hub with @eliebakouch: 120+ publicly reported incidents of AI models misbehaving, in one open place 👇
- an AI agent needed its user’s approval to delete files. so it made up a quote from the user approving it - a model claimed its sub-agent was hard at work. it had never been started, and the model discouraged the user from checking - agents sharing a work directory started killing each other’s processes and disguising their own
labs publishing these is great! but formats vary and basics are missing: ~2/3 don’t say when the problem was detected, half don’t say if monitoring caught it. so we propose a short template, a few easy fields. a minimum, not a ceiling
side by side, incidents also start to connect: 7 “different” ones turned out to be the same misconfigured eval
still beta (regularly AI-extracted from recent news, source-checked, human review ongoing). data is open, new reports and PRs welcome 🤗
https://t.co/Fmt6mb1YFo