論文 / arXiv:2610.40632
SymAnt: Grounding Long-Horizon Action Anticipation with Adaptable Symbolic Priors
PLAIN SUMMARY / やさしい要約
人の行動を少しだけ見て、この先に何が起きるかを長く予想するのは、ロボットにとって大事です。SymAntは、短い動画から「状況の説明書」のような情報を組み立て、それを手がかりに先の行動の並びを作っていく方法です。さらに、その「説明書」に当たる知識を人が書き換えることで、追加の学習をせずに予想を調整できると述べています。たとえば、短い場面を見てから、ルールや知識のメモを頼りに次の手順を組み立て直す、というイメージです。
AIが専門用語を使わずに書いた解説です。内容の正確さは、下の原文の要旨で確認してください。
ABSTRACT / 要旨(原文)
As robots and intelligent systems increasingly interact with humans, they must anticipate long sequences of future actions from only brief observations. While purely neural models typically require extensive observations to predict future actions and remain difficult to interpret and adjust, symbolic priors offer a structured alternative. To this end, we introduce SymAnt, a novel neuro-symbolic approach that unifies the expressiveness of neural networks with the structured reasoning of scene and knowledge graphs. Given a short video, SymAnt performs a joint-search over both graphs to construct a symbolic context, enabling unified reasoning over spatial relationships, object attributes, affordances, and associated actions. This symbolic context serves as a prior for an iterative refinement process that progressively generates and improves the sequence of future actions. By grounding predictions in symbolic context, SymAnt anticipates long-horizon actions from short observation windows in a parameter-efficient manner, while enabling users to directly edit the underlying knowledge to adjust predictions without further training. Through our experiments, we demonstrate the effectiveness of SymAnt, particularly when only short observation contexts are available, across five diverse datasets: Breakfast, 50 Salads, EPIC-KITCHENS, EGTEA Gaze+, and Assembly101.
ここに表示しているのは原論文の要旨です。AIによる要約や解釈は含みません。
