AI News

Apple research team discloses humanoid robot control system HALO, validated on Unitree G1 with an average success rate of 91%

YicaiUpdated Nov 7 19:04

English text is being prepared.

AI summary

The Apple research team submitted the paper "Perceptive Humanoid Motion from Simulation" to arXiv, disclosing the autonomous humanoid robot control system HALO and deploying it on the Unitree G1, enabling motions learned in simulation to be executed in unfamiliar real rooms. The team completed 360 single-task tests across 6 real environments that had not been pre-scanned or mapped, achieving an average success rate of 91%; 3 composite tasks were each tested 10 times, with an average success rate of 70%, among which "duck under an obstacle—walk to the target—push the box" was 50%. The research team publicly released the data generation, model training, and deployment code, and noted that adding new physical tasks still requires manually writing prompts and designing motion keyframes; the robot currently relies mainly on visual perception, and incorporating tactile perception is one direction for future improvement.

Why read this

AI score 62

The paper publicly releases the data generation and deployment code for simulation-to-real-machine transfer, and provides per-scenario success rates for comparison with existing robot control approaches.

Topics

Tags

Body

据澎湃新闻,苹果研究团队披露机器人“大脑”研究进展。当地时间11月4日,苹果研究团队在预印本平台arXiv提交论文《Perceptive Humanoid Motion from Simulation》,披露了人形机器人自主控制系统HALO。研究团队将该系统部署在宇树科技的G1人形机器人上进行验证,让机器人将在仿真环境中学到的动作,带到陌生的现实房间中执行。研究团队还公开了数据生成、模型训练和部署代码,涵盖动作生成、动作跟踪、任务编排以及仿真和真实机器人运行等环节。据论文披露,研究团队在6个未预先扫描或建图的真实环境中开展360次单项任务测试,平均成功率为91%。另在一个真实环境中,对3种组合任务分别开展10次测试,平均成功率为70%。其中,“俯身通过障碍—走向目标—推箱子”这一组合的成功率为50%。

需要指出的是,仿真生成数据并未完全摆脱人工参与。团队表示,新增物理任务仍需人工编写提示词、设计动作关键帧,部分动作还使用了人类视频或动捕素材。研究团队同时指出,目前机器人主要依赖视觉感知,难以直接感知接触情况;当物体离开相机视野或被遮挡时,涉及较多接触的任务表现会下降。加入触觉感知,是后续改进方向之一。

Source

Yicai