論文 / arXiv:2610.31662
Reliable AI-Assisted Decisions via Selective Auditing
PLAIN SUMMARY / やさしい要約
AIが出す答えを毎回人がチェックするのは大変です。この研究は、AIが自分の「自信度」も一緒に出す状況で、どれだけ人がチェックするかをその場その場で決める方法を扱います。大事なのは「見逃されるAIの誤りの割合」が、決めた上限を超えないようにすることです。たとえるなら、全部の荷物を開けずに検査する空港の手荷物検査のように、必要なときだけ追加検査に回すイメージです。
AIが専門用語を使わずに書いた解説です。内容の正確さは、下の原文の要旨で確認してください。
ABSTRACT / 要旨(原文)
We consider online monitoring of an AI system that produces a sequence of decisions. At each round, the system outputs a proposed decision together with a confidence score estimating the trustworthiness of the decision. The decision and confidence score need not be produced by the same model: for example, one agent may propose a decision, while a separate verifier agent evaluates it and outputs a correctness or safety score. Based on this information, we must decide whether to accept the AI decision automatically or consult an expert, such as a human auditor, who reviews the proposal and either accepts or corrects it. We formulate this task as an online constrained optimization problem in which the goal is to minimize the frequency of expert auditing while guaranteeing that the fraction of AI errors that go unaudited stays below a user-defined threshold. We derive a family of algorithms with provable error-control guarantees with no assumptions, including a method that is optimally efficient: it asymptotically attains the best achievable auditing rate for both adversarial and i.i.d. data streams. Experiments on screening harmful requests to large language models, qualitative text annotation, and data labeling show that our methods achieve valid error control in practice while substantially reducing the need for human auditing compared to baselines.
ここに表示しているのは原論文の要旨です。AIによる要約や解釈は含みません。
