SHIRITAS

論文 / arXiv:2610.30136

Agentic World Action Models

PLAIN SUMMARY / やさしい要約

ロボットに「次に何が起きそうか」を見通させる方法はありますが、同じ作業の手順を部品のように使い回す仕組みは弱いことがあります。この研究は、作業手順をコードとして扱い、そのコードと将来の映像・動作の予測を一緒に作る枠組みを提案します。さらに、似た手順が何度も出てくるときに、まとめて“道具箱”に入れる仕組みも入れています。たとえるなら、未来予想をしながら、よく使う手順書を整理して増やしていくような発想です。

AIが専門用語を使わずに書いた解説です。内容の正確さは、下の原文の要旨で確認してください。

ABSTRACT / 要旨(原文)

Recent world action models provide visual foresight and future prediction for robot manipulation, but lack explicit mechanisms for compositional skill reuse. Agentic robotics combines code-based planning and reasoning with reusable skills, but often lacks predictive grounding in physical dynamics. We introduce AW-0, an agentic world action model framework that integrates code-based planning with joint video and action prediction. We jointly model code, future video, and robot actions as three coupled generative streams within a unified mixture-of-transformers architecture. Within this architecture a code expert generates parameterized skill routines and control logic while video and action experts generate future visual states and low-level motor commands. Code serves two complementary roles: it structures multi-step prediction and control within the world model and represents skills as reusable programs for subsequent agentic execution. We further introduce an automated curation pipeline that labels robot and human video trajectories with aligned programs and consolidates recurring routines into reusable skill libraries. Evaluations on RoboTwin 2.0 and physical bimanual manipulation tasks show improved task performance over VLA and WAM baselines, alongside gains in language following, semantic reasoning and robustness, demonstrating that agentic code enables connection between planning, prediction and execution within WAMs.

ここに表示しているのは原論文の要旨です。AIによる要約や解釈は含みません。

この論文を取り上げた記事