SHIRITAS

論文 / arXiv:2610.37666

ThinkWorld: World Imagination Reinforces Chain-of-Dynamics Reasoning

PLAIN SUMMARY / やさしい要約

ロボットに作業を覚えさせるには、何をどう動かしたかという「答え付きの手本」がたくさん必要になりがちです。そこでこの研究は、人間の動画のように「動かし方の答え」が書かれていない映像からも学べる道を探ります。ポイントは、行動そのものを直接教える代わりに、「動いた結果、世界がどう変わったか」を手がかりに行動を選び直すことです。たとえるなら、手順書がなくても、やってみた後の出来上がりを見て次の手を調整していくような考え方です。

AIが専門用語を使わずに書いた解説です。内容の正確さは、下の原文の要旨で確認してください。

ABSTRACT / 要旨(原文)

Vision-Language-Action (VLA) models have made substantial progress in robotic manipulation, but their generalization remains constrained by the diversity and coverage of action-labeled robot demonstrations. Human videos provide much broader behavioral and environmental experience, while learning from them faces a fundamental trade-off between scalable data and explicit action grounding. We introduce ThinkWorld, a VLA learning framework that grounds action reasoning in world dynamics and strengthens it through reinforcement learning with world imagination. ThinkWorld represents each action thought as a Chain-of-Dynamics (CoD), a sequence of discrete motion tokens that captures the intermediate dynamics connecting the current world to a future state and serves as a common action representation across embodiments. We first initialize CoD with action-labeled demonstrations, then predict the future induced by each CoD and reinforce those whose predictions better match the observed outcome. This enables videos without action annotations to provide direct supervision from observed state transitions, allowing human and robot experience to refine the same reasoning space. Experiments in simulation and on real robots demonstrate effective human-to-robot transfer and strong generalization to unseen tasks and environments.

ここに表示しているのは原論文の要旨です。AIによる要約や解釈は含みません。

この論文を取り上げた記事