SHIRITAS

論文 / arXiv:2611.23219

Do LLM Agents Still Need to Be Told How to Self-Improve?

PLAIN SUMMARY / やさしい要約

AIに「上達してね」とだけ伝え、最低限の道具だけ渡したら、AIは自分で練習方法まで考えられるのでしょうか。本研究は、ゲームを使って、この問いを確かめています。外から細かな学習の回し方は指示せず、AIが試行錯誤できる状況を用意しました。その結果、能力が十分高いAIでは、そうした状況でも上達が見られたと報告しています。たとえば、コーチが練習メニューを細かく決めなくても、選手が自分で練習のやり方を組み立てていくようなイメージです。

AIが専門用語を使わずに書いた解説です。内容の正確さは、下の原文の要旨で確認してください。

ABSTRACT / 要旨(原文)

LLM agents increasingly drive their own learning. Self-improvement methods delegate various components of model optimization to the models themselves. As models become more capable, this motivates a basic question: do these increasingly capable models still need us to specify how they should self-improve? In this paper we study an autonomous paradigm in which, given basic primitives, resources, and a general goal for self-improvement, agents construct their own self-learning algorithm for context-based optimization. Using the setting of gameplay as a testbed, a frozen LLM agent is given a compute budget and tools for collecting experience and updating text documents, and allowed to freely experiment without an externally imposed loop or access to real-world data. We find that sufficiently capable models do self-improve under these conditions, demonstrating strategies that align with classic cognitive frameworks for self-regulated learning and constructs from machine learning literature on self-generated curricula. Furthermore, we study the extent to which the learned text artifacts transfer to external benchmarks, observing improvement across different game horizons, mechanics, and 3D navigation.

ここに表示しているのは原論文の要旨です。AIによる要約や解釈は含みません。

この論文を取り上げた記事