Smart Note · Series
Human Data
How robots learn perception and action from human experience.
13 articles

Human Data, Episode 1: Yanjie Ze on TWIST and Whole-Body Humanoid Teleoperation
Yanjie Ze discusses human motion capture, real-time retargeting, RL plus behavior cloning, GMR and the practical design of whole-body humanoid teleoperation.

Human Data EP02 — Motion Capture: GMT
An interview on GMT, general motion tracking, motion-capture datasets, mixture of experts, and whole-body humanoid control.

Human Data EP03—Motion Capture: ExBody2
Mazeyu Ji discusses whole-body tracking, motion retargeting, balanced training data, specialist policies and the path from imitation to autonomous tasks.

Human Data, Episode 4—Video: Junyi Zhang on VideoMimic
Reconstructing human motion and scene geometry from casual videos, training contextual humanoid control, and balancing scalable video data with precise motion capture.

Human Data EP05—Video: HuB
Tong Zhang and Boyuan Zheng discuss extreme humanoid balance, reference motion refinement, balance-aware learning and robust sim-to-real transfer.

Human Data EP06—Motion Capture and Video: GAE
Yuefan Wang discusses General Action Expert, scaling human motion data, supporting different control inputs and building a path from teleoperation to autonomy.

Human Data EP07 — Motion Capture: TWIST2
An interview on TWIST2, low-fidelity motion capture, wearable VR devices, and large-scale humanoid data collection.

Human Data EP08: OmniRetarget
An interview with Lujie Yang on interaction-preserving motion retargeting, hard kinematic constraints, data augmentation, and combining optimization with learning for humanoids.

Human Data — The “Key” to Robot Data: Series Summary
A review of eight Human Data interviews, the human-data pyramid, motion capture versus video, and retargeting methods.

An Interview with Lei Han: Noitom Robotics and the Human-Data Challenge, Part One
Lei Han discusses reinforcement learning, the human-data pyramid, optical–inertial motion capture, multimodal collection and opportunities for robot manipulation.

An Interview with Ruoli Dai: Noitom Robotics and the Human-Data Challenge, Part Two
Ruoli Dai explains motion-capture technology, optical and inertial tracking, human-centered data collection and a reusable, cross-embodiment data business.

A Conversation with Danfei Xu: Human Data Is Robot Data in Disguise
Danfei Xu discusses collecting and modeling human data, human-to-robot transfer and sensorimotor intelligence.

ModalityNet: Compiling Human Data into Learnable Robot Data
A full conversation with Noitom Robotics founder Ruoli Dai about MOV, OM, ITW, cross-embodiment transfer, multimodal sensing, and the World Compiler.
No matching articles.