- [2026.10.12] HoloMotion v2.0 brings one policy for sparse-to-whole-body control, with initial 1-point and 5-point real-robot teleoperation demonstrated.
- [2026.07.16] HoloMotion v1.4 introduces HoloRetarget at 3,000+ FPS on RTX 4090 for training data generation and 300+ FPS entirely on-robot for teleoperation, plus HoloSMPL for 10+ datasets and devices.
- [2026.05.15] HoloMotion v1.3 scales from 60M to 0.4B parameters and 80 to 2000+ hours of motion data, while improving policy inference from ~100 to ~300 FPS.
HoloMotion progresses from general motion tracking in v1 to flexible command following in v2, then toward cross-embodiment generalization in v3 and terrain generalization in v4.
| Version | Target Capability | Status | Focus |
|---|---|---|---|
| v1 | Any Pose | ✅ Released | Scale motion tracking with large pretrained models, fast inference, and generalization to unseen motions and real robots. |
| v2 | Any Command | 🚀 Preview | Unify sparse-to-whole-body commands in one policy, with an SMPL interface for cross-modal extensions. |
| v3 | Any Embodiment | 🧭 Planned | Generalize motion and command following across humanoids with different morphologies and actuation. |
| v4 | Any Terrain | 🧭 Planned | Adapt whole-body control to uneven and dynamic terrain, maintaining balance and coordinated motion in complex environments. |
HoloMotion v1 uses a reference-conditioned MoE Transformer to track diverse human motions on humanoid robots.
- Larger: Up to 0.4B parameters trained on 2,000+ hours of motion, combining video-derived data with motion capture.
- Faster: Sequence-level training and KV-cache inference support efficient learning and real-time control.
- Stronger: Generalization to unseen motion datasets and real-robot transfer without task-specific fine-tuning, as documented in the HoloMotion-1 Technical Report.
- One policy, multiple command modes: Pelvis-1 and Keypoint-5 (pelvis, wrists, and ankles) use the same model with selectable control-point masks.
- Cross-modal extensibility through SMPL: The shared SMPL interface is designed to simplify integration of external text-to-motion and music-to-motion models; these adapters are not yet included.
- Live teleoperation: Initial 1-point and 5-point PICO VR trials have been completed on G1. See deployment.
v2.0 is in release preparation; real-robot gait and tracking quality are still being refined, especially for pelvis-only control. Validation coverage varies across modes.
Motion Conversion → Retargeting → Policy Training → Simulation Evaluation → Robot Deployment
HoloSMPL standardizes VR, inertial, optical, and vision capture into a shared representation. HoloRetarget converts these motions into robot references for data generation and live teleoperation.
Start with the v2.0.0 motion-tracking checkpoint for simulation and live control; train or fine-tune only when you need to adapt the policy.
| Goal | Guide | Starting Point |
|---|---|---|
| Replay a motion in MuJoCo | Sim2sim | ONNX/config bundle and a robot NPZ clip. |
| Evaluate a motion dataset | Quantitative evaluation | ONNX/config bundle, actor weights, and robot HDF5 data. |
| Teleoperate a G1 | Robot deployment | G1 29-DOF with Orin, matching deployment image, and PICO / XRoboToolkit. |
| Train or fine-tune | Training | Labeled robot HDF5 data and GPU resources; a compatible checkpoint for fine-tuning. |
For workstation workflows, begin with environment setup. Each guide specifies the required artifacts and commands.
| Organization | Project | Use of HoloMotion | Links |
|---|---|---|---|
| Tsinghua University · MARS Lab | OMG | Uses HoloMotion as the tracker for executing generated motions, with G1 deployment workflows. | Paper / Project / Code |
| Peking University · School of Computer Science | HumanoidTTT | Keeps HoloMotion frozen as the whole-body tracker for reusing validated motions. | Paper / Project / Code |
| RoboParty Lab | sim2real | Supports the official HoloMotion v1.4.0 ONNX policy in its simulation and robot deployment stack. | Code / Docs |
| ccrpRepo | RoboMimic Deploy | Implements HoloMotion as a selectable G1 policy, with ONNX inference and motion or velocity tracking modes. | Code / HoloMotion policy |
| Renforce Dynamics | GenesisLab / genPiHub | Integrates HoloMotion v1.2 into Genesis simulation. Velocity tracking is implemented; motion tracking is still in progress. | GenesisLab / genPiHub |
The HoloMotion-2 Technical Report is scheduled for release alongside HoloMotion v2.1 at the end of October 2026. In the meantime, please cite the HoloMotion-1 report:
@misc{chen2026holomotion1,
title = {HoloMotion-1 Technical Report},
author = {Maiyue Chen and Kaihui Wang and Bo Zhang and Xihan Ma and Zhiyuan Yang and Yi Ren and Qijun Huang and Zihao Zhu and Yucheng Wang and Zhizhong Su},
year = {2026},
eprint = {2605.15336},
archivePrefix = {arXiv},
primaryClass = {cs.RO},
url = {https://arxiv.org/abs/2605.15336}
}Built on and inspired by these open-source projects:




