AI 热点

研究人员向 AI 供应链植入 200 万个金丝雀,发现敏感数据大量泄露

Ars Technica更新于 11月21日 06:29

Researcher plants 2m canaries into the AI supply chain. A privacy disaster surfaced.

AI 导读

研究人员 HD Moore 在 AI 服务请求中植入 200 万个数字金丝雀,发现由路由器、网关和推理服务组成的供应链会泄露高度敏感的数据。实验将 AWS 访问密钥、SSH 等服务密码、唯一 URL、DNS 名称及私有 git 仓库引用分别放入发送给单一提供商的提示词,并通过受控基础设施追踪泄露链路。

推荐理由

AI 评分 69

实验用可追踪凭证定位 AI 服务链中的泄露环节,为评估路由与网关带来的数据暴露风险提供了具体方法。

主题

标签

正文

Researchers planted 2 million digital tripwires in requests sent through a sprawling network of AI services to find out what happened to sensitive information entrusted to them. What they discovered was an ecosystem that leaked highly sensitive data like a sieve.

The exposure was found through an ingenious experiment designed to test if sensitive information can leak through the vast chain of widely used AI services and how that information is exploited when it does. Many of today’s AI apps use services such as OpenRouter or Vercel that act as brokers. These “AI routers,” sometimes also known as “AI gateways,” receive large numbers of prompts sent from AI app end users and route them to an available inference engine based on criteria such as the one charging the lowest price or being best suited for the given task. Instead of using Anthropic, OpenAI, or another big provider, the developer hires an AI router to find the most suitable model.

Security breaches, prompt theft, and privacy violations

To test for potential leakage, researcher HD Moore assembled a collection of AWS access keys, functioning credentials tied to empty AWS accounts, passwords for services such as SSH, and unique URLs, DNS names, and private git repository references. None of the secrets had ever been used before, and he controlled the infrastructure that received any requests using the credentials. He then seeded each secret into exactly one prompt sent to a single provider. In the event any of the secrets were leaked, these “canaries”—so called because they resemble the role of that bird when taken into coal mines—would allow Moore to identify each link in the chain that was responsible.

Read full article

Comments

来源

Ars Technica