SHIRITAS

論文 / arXiv:2610.32965

RynnUnify: Towards Unified Embodied Brain

PLAIN SUMMARY / やさしい要約

この研究は、映像と言葉を手がかりに「次に何が起きそうか」を考えながら、状況理解と長い手順の計画をまとめて扱うAIモデルを提案します。さらに、見えていない部分を推測するために予測を使う拡張や、ロボットを動かすための拡張も加えました。新しい評価用データ(Rynn-VPとRynn-GEU)を作り、性能を確かめたと述べています。たとえるなら、作業の様子を動画で見ながら説明文も読み、次の一手を考えて実際に手を動かすところまでを、ひとつの頭脳でつなげようとする試みです。

AIが専門用語を使わずに書いた解説です。内容の正確さは、下の原文の要旨で確認してください。

ABSTRACT / 要旨(原文)

We introduce RynnUnify, a 16B unified embodied model that combines strong embodied understanding with long-horizon visual planning through interleaved video--language reasoning. With capabilities spanning spatial reasoning, physical prediction, and grounding, RynnUnify connects an understanding of the physical world with visual anticipation of how it evolves across successive subtasks. Building on these capabilities, we further develop an agentic extension through reinforcement learning to selectively use video predictions for reasoning about unobserved states and interaction outcomes. We also develop a world-action extension of the full RynnUnify model, translating its understanding and prediction capabilities into robot control. To evaluate these capabilities, we introduce Rynn-VP and Rynn-GEU for long-horizon visual planning and anticipatory reasoning. Experiments show that RynnUnify achieves the highest average embodied understanding score among the evaluated unified multimodal models and improves the Rynn-VP overall score by 9.75 points over Cosmos 3 Nano. Its agentic extension improves the Rynn-GEU average by 6.0 points over direct reasoning, while the world-action extension achieves 51.5\% success on 20 selected composite RoboCasa365 tasks and 46.7\% average success across three real-robot tasks. Together, these results establish RynnUnify as a shared foundation for embodied understanding, visual planning, and robot control, taking a step toward a unified embodied brain.

ここに表示しているのは原論文の要旨です。AIによる要約や解釈は含みません。

この論文を取り上げた記事