SHIRITAS

論文 / arXiv:2611.21545

Right Reason, Wrong Advice: Evaluating Recourse in LLM Explanations of Denied Requests

PLAIN SUMMARY / やさしい要約

ルールで何かが「だめ」と言われたとき、AIが理由を説明してくれる場面が増えています。でも、理由が正しくても、そのとおりに直したのに結局また「だめ」になることがあります。この研究は、そうした「直し方の案内として役に立つ説明か」を確かめています。たとえば、鍵が開かないときに「電池切れです」と言われて電池を替えたのに、実は別の故障もあって結局開かない——そんなすれ違いに近い問題です。

AIが専門用語を使わずに書いた解説です。内容の正確さは、下の原文の要旨で確認してください。

ABSTRACT / 要旨(原文)

Language models increasingly write the explanations people receive when a rule system denies their request. If several rules deny the request independently, an explanation can name a true reason and still leave the person denied after they fix it. We call the missing property recourse validity: changing what the explanation cites, without changing what was asked for, can flip the decision. We compute it exactly, and a hitting-set argument predicts from the policy alone when a correct reason fails. In six of seven rule systems ported from access control and US benefit eligibility, a single correct reason almost never gives recourse when several reasons apply. Across 20 LLMs, checks of whether the cited reasons are correct, computed or asked of an LLM judge, are close to chance at spotting this failure, as the argument predicts. A strong judge asked whether acting on the explanation would work does spot it. Stronger and reasoning models do better but still fail on many denials with four or more independent reasons. Asking for every rule helps every open model with room to improve. Explanations of eligibility decisions should be built from the decision function and judged by whether acting on them works.

ここに表示しているのは原論文の要旨です。AIによる要約や解釈は含みません。

この論文を取り上げた記事