論文 / arXiv:2610.37648
Scaling Laws for Tool-Use Agents via Controllable Environment Synthesis
PLAIN SUMMARY / やさしい要約
AIに道具の使い方を教えるとき、練習問題の「数」だけ増やすのが最善とは限らない、という話です。研究者は、道具の種類や道具が触る情報の種類などを意図的に変えた“人工の練習環境”を作り、どんな作り方が本番での強さにつながるかを調べました。その結果、環境の作り方から本番での成績を予測できる関係式を作れたと述べています。たとえば、同じ予算で練習を増やすなら、同じ問題をたくさん解かせるより、いろいろな道具や情報に触れさせる方が良い場合がある、という示唆です。
AIが専門用語を使わずに書いた解説です。内容の正確さは、下の原文の要旨で確認してください。
ABSTRACT / 要旨(原文)
We explore how to build performant large language model (LLM) tool-use agents that complete complex, multi-step tasks. Specifically, we study how data composition in synthetically generated tool-use environments affects the training of such agents. To do so, we propose the SynthAPI pipeline, which explicitly controls the diversity of generated environments along the axes of tools, tasks, and the databases on which the tools operate. By systematically varying SynthAPI's generation controls in 458,752 tasks across 849 trained models of four different sizes, we derive a scaling law that predicts downstream tool-use agent generalization based on the scale and composition of the synthesized environments. These predictable relationships reveal several lessons for scaling tool-use agent data. As data budgets grow, scaling tool and database diversity becomes more effective than increasing the number of tasks, and increasing data complexity yields larger gains. Scaling according to these findings yields agents that outperform models trained on data from prior work in large-scale tool-use agent and synthetic environment generation across four evaluation benchmarks.
ここに表示しているのは原論文の要旨です。AIによる要約や解釈は含みません。
