論文 / arXiv:2610.22323
Mem4Act: Learning Effective Latent Memory for Long-Horizon Robotic Manipulation
PLAIN SUMMARY / やさしい要約
長い作業をするロボットは、前に見たことや起きたことを覚えておく必要があります。Mem4Actは、その「覚えておく内容」を小さな固定サイズの入れ物にまとめ、次の行動に使いやすくする考え方です。例えるなら、長い出来事の全部を持ち歩く代わりに、必要な要点だけをメモにして持ち歩くようなものです。複数のベンチマークや実世界タスクで、うまくいく割合が報告されています。
AIが専門用語を使わずに書いた解説です。内容の正確さは、下の原文の要旨で確認してください。
ABSTRACT / 要旨(原文)
Long-horizon robotic manipulation fundamentally requires memory: agents must retain task-relevant information from past observations and interactions and use it to guide future actions. Existing approaches typically preserve raw historical observations, compressed visual tokens, or language summaries, but these representations either expose the action policy to increasingly long histories or risk discarding task-relevant temporal, semantic, and perceptual information. We introduce Mem4Act, a framework for learning effective latent memory as a fixed-size representation explicitly optimized for long-horizon robotic control. Mem4Act addresses three coupled challenges: how to efficiently cover long histories, what information memory should retain, and how to ensure the policy actually relies on memory. To this end, it organizes history via multi-granularity temporal aggregation, preserves complementary semantic and perceptual information through question-answering supervision and key-frame DINO feature reconstruction, and employs memory-first two-stage training to encourage greater use of memory by the action policy. The resulting memory captures both high-level task state and fine-grained perceptual evidence while providing a bounded interface to the action policy. Across RoboMME, RMBench, and four real-world manipulation tasks, Mem4Act achieves state-of-the-art performance on memory-dependent control, with success rates of 49.88%, 61.0%, and 81.5%, respectively. Extensive ablations further demonstrate the importance of temporal aggregation, complementary memory supervision, and memory-first training.
ここに表示しているのは原論文の要旨です。AIによる要約や解釈は含みません。
