Aaron Levie：企业智能体落地卡在真实环境评测
A decent amount of agent adoption and deployment is bottlenecked by being able to test, tune, and optimize agents on “real” work environments. The files agents
Aaron Levie 认为，智能体落地的一大瓶颈是缺少在“真实”工作环境中测试、调优和优化智能体的能力，涉及文件、CRM、邮件等环境。企业目前只能逐个搭建评测与模拟环境，过程缓慢繁琐；他判断每家企业未来都会有人负责评测管理及评测与模拟环境的基础设施。被引帖中 Ofir Ehrlich 宣布 Era 上线并免费，可生成覆盖 Salesforce、Slack、Jira、Zendesk、Gong、Deel 等的完整模拟企业，智能体通过实时 MCP 和 API 接口交互。
查看原帖You can’t safely test an enterprise agent on a real company’s data. So we built a company for it to work in. Era is live today, and it’s free. It generates a complete simulated enterprise that behaves like a real one across Salesforce, Slack, Jira, Zendesk, Gong, Deel and more, along with cloud databases and storage. Agents interact with it through live…
展开完整原文
You can’t safely test an enterprise agent on a real company’s data. So we built a company for it to work in. Era is live today, and it’s free. It generates a complete simulated enterprise that behaves like a real one across Salesforce, Slack, Jira, Zendesk, Gong, Deel and more, along with cloud databases and storage. Agents interact with it through live MCP and API interfaces. People leave. Deals change. Records get duplicated. Permissions differ across systems. And because Era generated the company, it knows the exact ground truth. Test, benchmark and improve agents against realistic enterprise workloads, use the failures for targeted post-training, then rerun the same environment to measure the impact. Huge thanks to our research partners @NVIDIA, @Decart, @Composio, @openlayerco, @Deel, @Eragon and @Plurai, with more coming soon.
正文
当前显示原文，中文全文译文尚未就绪。
A decent amount of agent adoption and deployment is bottlenecked by being able to test, tune, and optimize agents on “real” work environments. The files agents need to access, the CRM environments, email, and more.
It’s impossible to know how agents are performing if you don’t understand how well they’re executing on your evals and how they’ll perform in the future with a model change or workflow upgrade. Every enterprise has to do this 1 by 1 right now, which is obviously slow and tedious.
Every enterprise is going to have someone managing evals, infrastructure for building and running evals and simulated environments, and more. Huge space.