腾讯混元推出 WebCraftBench 智能体评测基准
The AI says the site is done. Then the homepage errors, the buttons overlap, and it added a login flow you never asked for. 🙃
AI 导读
AI 说网站做好了。然后首页报错、按钮重叠，还加了你从没要求过的登录流程。🙃 介绍 WebCraftBench：智能体真正使用线上应用，覆盖率引导的探索找出从未被触达的部分，然后我们评估美观度、可用性，以及原始需求是否被满足。 在 197 个人工验证的配对样本上，它与人类偏好的匹配率为 85.3%。 论文：https://t.co/0QT2srOKTZ
正文
当前显示原文，中文全文译文尚未就绪。
The AI says the site is done. Then the homepage errors, the buttons overlap, and it added a login flow you never asked for. 🙃 Introduces WebCraftBench: agents actually use the live app, coverage-guided exploration finds what never got reached, then we score aesthetics, usability, and whether the original request was met. On 197 human-validated pairs, it matches human preference 85.3% of the time.