論文 / arXiv:2610.26855
Ropedia W0: Scaling Loco-Manipulation World Models across Embodiments with Human Experience
PLAIN SUMMARY / やさしい要約
ロボットが動く前に「次に何が起きそうか」を見通す仕組みとして、世界モデルがあります。この研究は、人間とロボットの視点(頭にカメラがあるような映像)を集め、歩くような移動と、手で物を扱う操作を一緒に予測できるモデルを作ろうとします。例えるなら、いろいろな体格の人や道具の使い方を、同じ教科書の形式で学べるように整理して学習させるイメージです。著者らは、集めたデータと評価用の課題で性能を確かめ、良い結果が出たと述べています。
AIが専門用語を使わずに書いた解説です。内容の正確さは、下の原文の要旨で確認してください。
ABSTRACT / 要旨(原文)
World models enable embodied agents to anticipate action consequences, yet jointly modeling locomotion and manipulation across diverse embodiments remains challenging due to heterogeneous action spaces and limited multimodal supervision. We present Ropedia W0, the first egocentric loco-manipulation world foundation model spanning humans and robots with diverse embodiments. We curate Xp-Data, comprising 10k hours of egocentric human data and 3k hours of robot data with unified multimodal annotations and systematic quality control. A unified kinematic representation encodes locomotion through camera poses and manipulation through projected skeletons, with robot skeletons combining embodiment-specific forward kinematics with extensive manual keypoint annotation and correction. We also introduce Xp-Teleop, a long-horizon loco-manipulation benchmark based on high-quality dexterous humanoid teleoperation data. Evaluations demonstrate state-of-the-art performance across five cross-embodiment benchmarks (DreamDojo, $Ψ_0$, $ω$-HOME, Xp-Teleop, and AgiBot) and on held-out human egocentric video, from zero-shot inference to few-shot and full-data post-training. Scaling human pre-training data improves performance on both human and robot evaluations. After distillation, our model supports real-time, minute-long rollouts, enabling live VR interaction. Applications in policy evaluation, model-based planning, and world-action modeling further demonstrate the model's utility for embodied decision-making.
ここに表示しているのは原論文の要旨です。AIによる要約や解釈は含みません。
