SHIRITAS

論文 / arXiv:2610.12470

Dex-One2Many: Learning Dexterous Manipulation from a Single Human Demonstration

PLAIN SUMMARY / やさしい要約

この研究は、人が作業している動画を1本だけ見せて、ロボットの手が同じタイプの作業を覚える方法を提案しています。ポイントは、動画をそのまま真似するのではなく、場面ごとの「物と物の関係」をメモのように書き起こして学習の道しるべにすることです。そのメモを使って、練習の出発点をいろいろ作ったり、うまくいっているかを細かく点数化したりします。たとえるなら、料理動画の手の動きを完コピする代わりに、「材料がどこにあって、何をどこへ動かすか」という段取り表を作って練習するような発想です。

AIが専門用語を使わずに書いた解説です。内容の正確さは、下の原文の要旨で確認してください。

ABSTRACT / 要旨(原文)

While learning dexterous manipulation from a single human video offers a promising alternative to costly robot demonstrations, many recent methods predominantly imitate demonstrated motions. Such strict motion matching often limits generalization to initial object poses, goal poses, and grasps not shown in the video. Alternatively, discovering a policy via reinforcement learning (RL) allows for broad generalization, but without prior guidance, it struggles with high-dimensional exploration in complex, multi-stage tasks. To address these coupled generalization and exploration challenges, we present Dex-One2Many, a real-to-sim-to-real framework that learns a generalizable dexterous manipulation policy from a single human video. Our key insight is to abstract the video into sequential scene graphs that guide RL, enabling efficient exploration while preserving broad generalizability. The graphs serve as generative constraints for sampling diverse reset states and provide dense rewards for each stage. Because the graphs constrain relations rather than exact poses, these reset states cover object poses and grasps beyond the video, while initializing each stage from them with dense rewards keeps exploration short and guided. Trained entirely in simulation, Dex-One2Many transfers zero-shot to a real multi-fingered hand. Across five tool-use and manipulation tasks, Dex-One2Many exceeds baselines by 6.5% in seen configurations, while its robust generalization widens this gap to 71% in unseen scenarios.

ここに表示しているのは原論文の要旨です。AIによる要約や解釈は含みません。

この論文を取り上げた記事