Nvidia 发布 Open Agent Safety Platform，称可在毫秒级隔离失控智能体
Nvidia says its new AI safety platform can contain rogue agents within ‘milliseconds’
Nvidia 发布 Open Agent Safety Platform，称可在毫秒级隔离试图越界的 AI 智能体。该平台基于开源软件 OpenShell，运行在 Nvidia 的 Vera AI CPU 上，用户可限定智能体可访问的信息，OpenShell 会在任务执行前和执行中检查这些限制，另有独立芯片上的 Sentry 技术持续监控智能体并执行边界。Anthropic、Microsoft 和 SpaceX 等公司对该平台表示支持。
正文
当前显示原文，中文全文译文尚未就绪。
Nvidia is launching a new safety platform designed to contain and monitor AI agents, a move that comes in response to a wave of rogue hacking incidents , as reported earlier by Reuters . In an announcement on Monday , Nvidia says its new Open Agent Safety Platform can quarantine agents that attempt to escape their boundaries within “milliseconds.”
The platform uses Nvidia’s OpenShell open-source software, which runs on the company’s Vera AI CPU . Users can choose the information an AI agent can access, and OpenShell checks these restrictions before and during a task, according to Nvidia . It also includes Nvidia’s Sentry technology on a separate chip to continuously monitor agents and enforce boundaries.
During an interview with CNBC , Nvidia CEO Jensen Huang emphasized the importance of giving AI agents access to only the information they need to do their job. “In order for you to deliver that agentic system in a safe way, you have to make sure that the sandbox around it… all of those systems are designed in a way that keeps the agent with minimal rights,” Huang said.
Concerns about AI safety have risen in recent weeks , as OpenAI , Anthropic , and Google have all revealed incidents where their AI models went outside their testing environments and hacked other companies. Several major tech companies are backing Nvidia’s Open Agent Safety Platform, including Anthropic, Microsoft, and SpaceX.
Update, September 28th: Added Huang’s CNBC interview.