Qwen opens MobilePA-Bench, MobileWorld, and other mobile agent benchmark suites
Qwen has open-sourced four benchmark suites—MobilePA-Bench, MobileWorld, MobileWorld-Real, and MobileWorld-Safety—covering planning, cross-app execution, real-device performance, and safety. These benchmarks correspond to the three types of agents released by Qwen Intelligence: Mobile Planner Agent ranks first on MobilePA-Bench, MobilePA-Bench Business, and Memory; Mobile-Use Agent scores 82.1 on MobileWorld, 92.2 on MobileWorld-Real, and 97.2 on AndroidDaily, with an end-to-end success rate of 90%; Mobile Creative Agent can generate images within 3 seconds, roughly twice as fast as comparable products.
obileWorld, MobileWorld-Real, and MobileWorld-Safety—covering planning, cross-app execution, real-device performance, and safety. These benchmarks correspond to the three types of agents released by Qwen Intelligence: Mobile Planner Agent ranks first on MobilePA-Bench, MobilePA-Bench Business, and Memory; Mobile-Use Agent scores 82.1 on MobileWorld, 92.2 on MobileWorld-Real, and 97.2 on AndroidDaily, with an end-to-end success rate of 90%; Mobile Creative Agent can generate images within 3 secon
Matched fieldsSummary
