論文 / arXiv:2610.13886
X-AgentRed: Red-Teaming Personal Agents in Evolving Multi-Service Ecosystems
PLAIN SUMMARY / やさしい要約
複数のサービスをつなぐAIが、頼まれた用事をこなす途中で、思わぬ悪い結果につながることがあります。そこで研究者は、どんな手順の組み合わせが危ないかを、道順の地図のように整理して探す方法を提案しました。その地図からいくつかの「手順の並び」を取り出して実際の場面として試し、うまくいかなかった点は条件を見直し、別の手段にも置き換えて広げていきます。4つのモデルで、比べた方法よりも多くの有害な手順を見つけ、使う道具の種類も広く探索できたと報告しています。
AIが専門用語を使わずに書いた解説です。内容の正確さは、下の原文の要旨で確認してください。
ABSTRACT / 要旨(原文)
Personal agents increasingly connect to services across the web and applications by using tools. As the effects of their actions accumulate and interact across services, unintended or harmful outcomes can arise when agents fulfill benign user requests. Proactively identifying these compositional failures requires systematically exploring diverse cross-service paths. Existing red-teaming methods often simply prompt LLMs to identify potentially harmful paths from task and environment descriptions or decompose harmful objectives specified by humans or LLMs into seemingly benign action combinations. However, generation is biased toward patterns learned during training, potentially favoring familiar tool combinations and leaving novel cross-service interactions underexplored. To address this, we propose X-AgentRed, a self-evolving red-teaming framework that discovers harmful tool call paths through a graph of tool dependencies and expands and refines them using execution feedback. By analyzing each tool's effects, potential harms, and preconditions for execution, the red-teaming agent constructs a directed graph that captures how one tool's effects can satisfy another's execution preconditions. Recipes sampled from this graph are instantiated as realistic scenarios in which agents can produce harmful outcomes. Execution feedback enables self-improvement by diversifying paths that produce harm through tool substitution and refining preconditions at blocked steps in unsuccessful paths to enable further execution. Across four frontier agentic models, X-AgentRed achieves $1.77\times$ the harmful path rate of STAC and explores a more diverse set of tools, yielding $2.99\times$ the tool coverage on average.
ここに表示しているのは原論文の要旨です。AIによる要約や解釈は含みません。
