AI News

Take Ten-Thousand: First-Person Perspective Data Collection for Humanoid Robots

ChinaTalkUpdated Nov 16 18:38

AI summary

On February 18, 2026, NVIDIA proposed first-person perspective (egocentric) data collection in the EgoScale project, shifting the collection method from isomorphic exoskeletons to head-mounted and wrist-mounted cameras, and captured 20,854 hours of first-person video for more than 1,000 people, mostly of everyday tasks such as washing dishes and chopping vegetables. The article reviews the evolution of three generations of robot data collection technology—teleoperation, isomorphic, and first-person perspective—and notes that by the end of 2025, China already had more than 150 humanoid robot companies and 40 state-owned robot data collection centers in operation.

Body · AI translation

why selling robot data is tough business; and ChinaTalk at CoRL!A. ChenOct 22, 2026

The ChinaTalk team is going to CoRL (the Conference on Robot Learning) in Austin! Reply to this email if you’d like to hang out between November 9th and 12th. We’re also doing karaoke on the 11th — RSVP here if you’d like to join!

A. Chen writes about people, technologies, and their relationships to power. Her submission, “Take Ten-Thousand: Egocentric Data Collection for Humanoid Robots,” won one of 7 Grand Prizes at the ChinaTalk Essay Contest. We’re thrilled to share this report from the frontlines of China’s robot data collection industry!

Where is the center of the universe? For the residents of Beijing, the answer is Wudaokou. The neighborhood houses China’s top universities, research institutions, and labs, drawing talent and funding from every corner of the country. The streets are radiant at night, packed full of bars and clubs that have somehow bounced back after the COVID-19 pandemic. And the number 13 metro line, which rattles overhead every five minutes, is never empty.

I came to Wudaokou to understand China’s AI industry — particularly, the hype surrounding humanoid robots, and the methods used to train them. Everyone has seen videos of these robots: eerily tall and lanky, some of them shedding nuts and bolts as they sprint down a track, others backflipping repeatedly on a dance stage. The global market for humanoid robotics, or embodied intelligence, is said to be worth $38 billion by 2035: the latest chapter in the U.S.-China technology race that has dominated international headlines for over a decade.

This year, China’s 15th Five-Year Plan declared embodied intelligence a matter of national priority, then laid a strategy for developing training grounds across the country. Over 150 humanoid robotics companies and 40 state-owned robot data collection centers were reported to be in operation in China by the end of 2025. According to the Global Times, Chinese embodied intelligence startups drew 50 billion yuan in investment deals by September 2025: an increase of 2.5 times from the previous year.

More recently, embodied intelligence startups have begun to focus on the human hand, whose articulation and coordination has yet to be replicated by robots. Data of the human hand can’t be generated passively, in the same way that an Instagram user’s scroll or like might be harvested, and researchers of embodied intelligence are racing to solve this dilemma with a number of techniques. Most recently, videos have begun to circulate of people wearing headsets and filming themselves at work — a technique called egocentric data collection — to train robot hands.

I sat down with the researchers and entrepreneurs behind China’s egocentric data collection space to understand the industry. Beneath the speculation, the social media virality, and the staggering amounts of investor money, what — and who — does it actually take to train a robot?

Tsinghua Science Park in Wudaokou, Beijing. David Baron via Flickr.The Third Wave of Data Collection

English text is being prepared.

Teleoperated data collection, the first generation of data collection techniques, appeared around 2017. That year, Stanford Professor Fei-Fei Li piloted a program that allowed users to connect their phones to remote controls that could control robot arms. Teleoperated data collection methods have since become more streamlined: a user stands several feet away from a robot and moves its body using remote controls, sometimes with a VR headset to simulate a different environment. According to Dr. Guo, the individuals responsible for teleoperated data collection often suffered from fatigue and joint pain after hours of performing slow, repetitive motions. Teleoperation was also expensive; hardware could cost hundreds of thousands of yuan per set. Even so, companies such as Helix, OpenXE, and PI (Physical Intelligence) collected tens of thousands of hours of data using this method. Most of the data collected was for gripper hands, which operated on a simple binary command: 0 for closed, 1 for open. Fine-grained, dexterous manipulations — such as cutting an apple, folding a shirt, or playing the piano — proved too complex for a user to simulate through a remote control.

English text is being prepared.

English text is being prepared.

English text is being prepared.

English text is being prepared.

English text is being prepared.

English text is being prepared.

English text is being prepared.

English text is being prepared.

English text is being prepared.

English text is being prepared.

English text is being prepared.

English text is being prepared.

English text is being prepared.

English text is being prepared.

English text is being prepared.

English text is being prepared.

English text is being prepared.

English text is being prepared.

English text is being prepared.

English text is being prepared.

English text is being prepared.

English text is being prepared.

English text is being prepared.

English text is being prepared.

English text is being prepared.

English text is being prepared.

Source

ChinaTalk