All writing

Smart Note · Series

Human Data

How robots learn perception and action from human experience.

13 articles

Human Data, Episode 1: Yanjie Ze on TWIST and Whole-Body Humanoid Teleoperation
Human Data · EP01

Human Data, Episode 1: Yanjie Ze on TWIST and Whole-Body Humanoid Teleoperation

Yanjie Ze discusses human motion capture, real-time retargeting, RL plus behavior cloning, GMR and the practical design of whole-body humanoid teleoperation.

2025-10-17 · 20 min read
Human Data EP02 — Motion Capture: GMT
Human Data · EP02

Human Data EP02 — Motion Capture: GMT

An interview on GMT, general motion tracking, motion-capture datasets, mixture of experts, and whole-body humanoid control.

2025-10-30 · 10 min read
Human Data EP03—Motion Capture: ExBody2
Human Data · EP03

Human Data EP03—Motion Capture: ExBody2

Mazeyu Ji discusses whole-body tracking, motion retargeting, balanced training data, specialist policies and the path from imitation to autonomous tasks.

2025-10-31 · 12 min read
Human Data, Episode 4—Video: Junyi Zhang on VideoMimic
Human Data · EP04

Human Data, Episode 4—Video: Junyi Zhang on VideoMimic

Reconstructing human motion and scene geometry from casual videos, training contextual humanoid control, and balancing scalable video data with precise motion capture.

2025-11-04 · 18 min read
Human Data EP05—Video: HuB
Human Data · EP05

Human Data EP05—Video: HuB

Tong Zhang and Boyuan Zheng discuss extreme humanoid balance, reference motion refinement, balance-aware learning and robust sim-to-real transfer.

2025-11-06 · 13 min read
Human Data EP06—Motion Capture and Video: GAE
Human Data · EP06

Human Data EP06—Motion Capture and Video: GAE

Yuefan Wang discusses General Action Expert, scaling human motion data, supporting different control inputs and building a path from teleoperation to autonomy.

2025-11-07 · 13 min read
Human Data EP07 — Motion Capture: TWIST2
Human Data · EP07

Human Data EP07 — Motion Capture: TWIST2

An interview on TWIST2, low-fidelity motion capture, wearable VR devices, and large-scale humanoid data collection.

2025-11-14 · 8 min read
Human Data EP08: OmniRetarget
Human Data · EP08

Human Data EP08: OmniRetarget

An interview with Lujie Yang on interaction-preserving motion retargeting, hard kinematic constraints, data augmentation, and combining optimization with learning for humanoids.

2025-11-30 · 17 min read
Human Data — The “Key” to Robot Data: Series Summary
Human Data

Human Data — The “Key” to Robot Data: Series Summary

A review of eight Human Data interviews, the human-data pyramid, motion capture versus video, and retargeting methods.

2025-11-30 · 8 min read
An Interview with Lei Han: Noitom Robotics and the Human-Data Challenge, Part One
Human Data

An Interview with Lei Han: Noitom Robotics and the Human-Data Challenge, Part One

Lei Han discusses reinforcement learning, the human-data pyramid, optical–inertial motion capture, multimodal collection and opportunities for robot manipulation.

2025-12-01 · 18 min read
An Interview with Ruoli Dai: Noitom Robotics and the Human-Data Challenge, Part Two
Human Data

An Interview with Ruoli Dai: Noitom Robotics and the Human-Data Challenge, Part Two

Ruoli Dai explains motion-capture technology, optical and inertial tracking, human-centered data collection and a reusable, cross-embodiment data business.

2025-12-02 · 18 min read
A Conversation with Danfei Xu: Human Data Is Robot Data in Disguise
Human Data

A Conversation with Danfei Xu: Human Data Is Robot Data in Disguise

Danfei Xu discusses collecting and modeling human data, human-to-robot transfer and sensorimotor intelligence.

2026-03-23 · 28 min read
ModalityNet: Compiling Human Data into Learnable Robot Data
Human Data

ModalityNet: Compiling Human Data into Learnable Robot Data

A full conversation with Noitom Robotics founder Ruoli Dai about MOV, OM, ITW, cross-embodiment transfer, multimodal sensing, and the World Compiler.

2026-07-20 · 25 min read