論文 / arXiv:2611.17239
When Both Sides Adapt: The Challenges of Evaluating Interactive LLM Systems
PLAIN SUMMARY / やさしい要約
人がAIの返答を見て、次の質問の仕方や難しさを変えると、AIの「テスト問題」自体が変わっていきます。すると、同じ問題集で比べる評価と、実際のやり取りの中で比べる評価では、比べている内容が一致しないことがあります。この論文は、そうしたズレが起きる理由を、比べ方(推定対象)の定義から整理します。たとえば、会話の途中で相手が出すクイズの種類が変わると、どちらが得意かの見え方が変わる、というイメージです。だから性能だけでなく、AIが人の行動をどう変えるかも見よう、と述べています。
AIが専門用語を使わずに書いた解説です。内容の正確さは、下の原文の要旨で確認してください。
ABSTRACT / 要旨(原文)
In interactive systems where users engage with LLMs, users are adaptive and, after observing LLM responses, can change their prompting strategy, as well as the type and difficulty of subsequent tasks. Thus model responses can influence the set of prompts on which the model is subsequently evaluated. We study the implications of this user adaptivity and prompt endogeneity for the evaluation of LLMs. We define two classes of estimands for comparing models: the common-distribution effect, which compares model performance on the same distribution of prompts, and the induced-distribution effect, which compares each model on the prompt distribution generated through user interaction. We show that offline benchmark evaluation and live A/B testing target different quantities, with the standard difference-in-means estimators for the two methods converging to the common-distribution effect and the induced-distribution effect, respectively. This distinction can affect decision-making: the two comparisons can rank models differently and lead to discrepancies in deployment recommendations. We characterize when such ranking reversals occur and provide a sufficient condition under which the rankings are guaranteed to agree. This result provides a practical heuristic for assessing whether offline evaluation is sufficient to reproduce the decision suggested by a live experiment. Third, we show, in a stylized linear model of interactions, that user adaptivity can increase variance in estimation. Finally, we discuss implications of user adaptivity for the interpretation of experiments and show that adaptivity creates a common mechanism leading to common evaluation challenges, such as reward hacking and novelty effects. Together, this work highlights the necessity of measuring both model performance as well as changes in the user behavior that the model induces.
ここに表示しているのは原論文の要旨です。AIによる要約や解釈は含みません。
