←新闻详情

面壁智能 OpenBMB更新于 10月25日 18:25

面壁智能 EC²-Bench 研究端云智能体协作

When should the cloud execute for the edge agent, and when should it just advise?

AI 导读

面壁智能与清华用 EC²-Bench 在 128 个可执行任务上评测四种端云协作策略,同时衡量任务完成度、资源成本与隐私暴露。端侧 Qwen3.5-9B 加云端 GLM-5.3 时,最佳协作得分 60.46,约为纯云端 82.70 的 73%,成本仅 $8.73,约为纯云端 $56.42 的 15%。弱端侧适合由外部路由器让云端执行(2B 模型 39.97 对 15.86),强端侧适合云端只给建议(9B 模型 60.46)。

正文

When should the cloud execute for the edge agent, and when should it just advise?

We present a systematic study of edge-cloud collaboration in long-horizon agent execution. Using EC²-Bench, we evaluate four collaboration strategies across 128 executable tasks, jointly measuring task completion, resource cost, and privacy exposure. Here are three key findings:

1️⃣ Small cloud budget, big gains.(cost-efficiency). With Qwen3.5-9B on-device and GLM-5.3 in the cloud, edge-only scores 39.12; the best collaboration reaches 60.46 — about 73% of cloud-only (82.70) — at only $8.73, roughly 15% of cloud-only's $56.42. 2️⃣ Performance converges, privacy doesn't. On Qwen3.7-Plus, best collaboration hits 76.84 vs 82.70 cloud-only; strategy gaps shrink to just 3.67 completion points, yet privacy exposure spans 66.23 percentage points — and the best-performing strategy leaks the most. 3️⃣ The mode flips with edge capability. Weak edges do best with an external router that lets the cloud execute (2B: Per-step Routing 39.97 vs self-delegation 15.86); stronger edges do best when the cloud only advises (9B Cloud Advisory 60.46). Further experiments highlight two abilities that matter for effective self-directed collaboration: knowing when to ask for help, and actually acting on the cloud's advice.

📄 Paper: https://t.co/ESc7nA1Aeu 🌐 Project: https://t.co/J1A3ZjtgCj 💻 Code: https://t.co/xjAuYnCDT1

#EdgeCloudCollaboration #AIAgent #LLM #OnDeviceAI #AgentBenchmark #EC2Bench #OpenBMB #Tsinghua

来源

面壁智能 OpenBMB