Understand this story
On October 24, 2026, OpenBMB released research on a device-cloud collaborative long-horizon agent execution system. This research, conducted by ModelBest in collaboration with Tsinghua University, uses EC2-Bench to evaluate four device-cloud collaboration strategies on 128 executable tasks, simultaneously measuring task completion, resource cost, and privacy exposure. The results show that with on-device Qwen3.5-9B plus cloud-based GLM-5.3, the best collaboration score is 60.46, about 73% of the pure-cloud score of 82.70, at a cost of only $8.73, about 15% of the pure-cloud cost of $56.42. The research also found that weak on-device models are suited to having an external router let the cloud execute, with the 2B model scoring 39.97 versus 15.86; strong on-device models are suited to the cloud providing only suggestions, with the 9B model scoring 60.46. The research has now been made public, with no subsequent progress yet.
AI-generated from public reports
Latest development · Report
ModelBest EC²-Bench Study on Device-Cloud Agent CollaborationDevelopments
1 confirmed developments
OpenBMB Releases Research on Device-Cloud Collaborative Long-Horizon Agent Execution System
Source:English text is being prepared.
Reports and discussion timeline
Browse reports and discussion by time. Their evidence levels remain distinct.
Oct 24
ModelBest OpenBMB
ModelBest EC²-Bench Study on Device-Cloud Agent Collaboration
ModelBest and Tsinghua used EC²-Bench to evaluate four device-cloud collaboration strategies on 128 executable tasks, measuring task completion, resource cost, and privacy exposure simultaneously. With on-device Qwen3.5-9B plus cloud GLM-5.3, the best collaboration score was 60.46, about 73% of the pure-cloud 82.70, at a cost of only $8.73, about 15% of the pure-cloud $56.42. Weak on-device setups suit having an external router let the cloud execute (2B model: 39.97 vs. 15.86), while strong on-device setups suit the cloud only giving suggestions (9B model: 60.46).