SHIRITAS

論文 / arXiv:2611.08462

OopsieRecover: Learning Transferable VLA Corrections from Semantic Interventions

PLAIN SUMMARY / やさしい要約

ロボットを動かすAIは、実際に使う場面で思わぬ失敗をすることがあります。そこでこの研究は、失敗したときに少しだけ「こう直して」と手本を見せるだけで、次からうまく立て直せるようにする考え方を提案します。ポイントは、手本の動きをそのまま覚えるのではなく、「なぜその直し方が必要だったのか」を推理して、別の場面でも使える形にすることです。たとえるなら、答えを丸暗記するのではなく、間違えた理由を理解して似た問題にも対応できるようにする、という方向性です。

AIが専門用語を使わずに書いた解説です。内容の正確さは、下の原文の要旨で確認してください。

ABSTRACT / 要旨(原文)

Vision-Language-Action (VLA) models can perform a wide range of robotic manipulation tasks, but often fail during deployment. Teaching them to recover from these failures requires substantial corrective data: existing approaches learn to recover from failures by directly associating corrective actions with the observations in which they were demonstrated. For instance, DAgger-like fine-tuning can require tens to hundreds of interactions, yet the resulting policy may still fail to generalize the learned corrections beyond the demonstrated scenarios. We hypothesize that semantics can capture the underlying reasons for failures and their corrections, enabling policies to learn from only a handful of corrective demonstrations and generalize those corrections to novel objects, and scene variations. We propose OopsieRecover, a framework that uses abduction to infer the intent behind a small set of corrective demonstrations and encodes the inferred knowledge as dense spatial representations and conditional costs. These costs capture when a behavior is undesirable and steer the policy toward more desirable action regions. We experiment across 6 tasks and variations in object poses, scenes, and related tasks, and find that only a handful of corrective demonstrations can enable a VLA to overcome failures across a broad range of novel situations, without requiring new corrective data for each variation. Please refer to https://robin-lab.cs.utexas.edu/oopsierecover for videos.

ここに表示しているのは原論文の要旨です。AIによる要約や解釈は含みません。

この論文を取り上げた記事