SHIRITAS

論文 / arXiv:2611.17303

Towards a Theory of Learnability via Debate

PLAIN SUMMARY / やさしい要約

AIを育てる方法として、2つのAIに討論させて人が勝ち負けを決めるやり方があります。本稿はこの方法を、勝負の分析というより「うまく学べるのか」という学習の問題として整理します。その結果、人が判定できる状況でも、いつも「対立する討論をさせる」ことが最善とは限らないと示します。たとえるなら、相撲の勝敗を研究するだけでなく、その勝敗の付け方で力士がどんな練習を身につけるかを考える、という視点です。

AIが専門用語を使わずに書いた解説です。内容の正確さは、下の原文の要旨で確認してください。

ABSTRACT / 要旨(原文)

Debate has been recently proposed as a training protocol that is hoped to produce more aligned models even as model capabilities scale. The idea is that the human, instead of providing supervision in the form of labels, judges a debate between two models that compete to prove the correctness of opposite labels. It can be shown that functions of a much higher computational complexity can be correctly judged in this way, compared to the complexity of functions that can be directly evaluated using a computationally weak evaluator. This suggests that perhaps debate can be used to teach very complicated functions to models. However, previous work has largely ignored the fact that this is a training protocol, and simply analyzes the game being played between the two debaters for a known judge. We take the first steps towards understanding the learning problem implicit within the protocol, by formulating it as an online learning problem. We show that once we formulate the learning problem precisely, there are cases where the best way to learn given access to a judge is different from running an adversarial debate. This motivates us to define a cooperative version of the protocol, whose learnability we characterize using a combinatorial dimension. We also consider the possibility of the human judge being fallible and occasionally judging the debate incorrectly. We show that a small number of errors in judgement can lead to a large error in learning.

ここに表示しているのは原論文の要旨です。AIによる要約や解釈は含みません。

この論文を取り上げた記事