論文 / arXiv:2610.22316
Learning to Steer LLM Agents and Multi-Agent Systems
PLAIN SUMMARY / やさしい要約
AIが長い手順の作業をしていると、途中で当初の目的から外れてしまうことがあります。研究者らは、作業の進み方を見張って、ズレたときに軌道修正する「監督役」のAIを提案しました。軽いチェックで介入が必要かを決め、必要なら重い処理で具体的な立て直し方を考えます。例えるなら、まずは交通整理の係が「止めるべきか」を素早く判断し、止めると決めたら別の係が「どこへ誘導するか」を詳しく決めるような仕組みです。
AIが専門用語を使わずに書いた解説です。内容の正確さは、下の原文の要旨で確認してください。
ABSTRACT / 要旨(原文)
Large language model (LLM)-based agents and multi-agent systems increasingly tackle complex tasks through long-horizon tool use and inter-agent collaboration. However, these systems are prone to deviating from the overall goal as execution unfolds, which wastes execution resources and leads to undesired outcomes, a failure termed goal drift. In this work, we propose a steering agent that supervises execution on the fly and steers the system back on track when drift occurs. The steering agent observes the execution context, deciding when to intervene with a low-cost fast path and how to intervene with a high-cost slow path. To unlock its steering intelligence, the ability to assess goal drift and generate effective interventions, we jointly train the two paths with reinforcement learning, combining a pairwise ranking objective with group-relative policy optimization (GRPO). Experiments on information-seeking search tasks show that the steering agent provides effective supervision for both single-agent and multi-agent systems, improving their performance and efficiency. The learned steering intelligence generalizes to out-of-domain tasks, transfers to unseen executors, and supports controllable intervention frequency without retraining.
ここに表示しているのは原論文の要旨です。AIによる要約や解釈は含みません。
