SHIRITAS

論文 / arXiv:2610.31650

EpiSEM-Bench: Evaluating Safety and Evidence Recovery in LLM Agents under Missing Evidence

PLAIN SUMMARY / やさしい要約

道案内の看板に「通行止め」の情報だけが抜け落ちていると、案内どおりに進んだ人が立ち入り禁止の道に入ってしまうかもしれません。この研究は、ツールを使うAIでも同じように「安全に大事な情報が抜けた」状態が起きると、やってはいけない行動をしてしまう可能性がある、と述べます。そこで著者らは、情報が欠けた状況でAIがどれだけ危ない行動をするか、また欠けた情報を探しに行って危ない行動を止められるかを確かめるテスト一式を提案します。複数のAIを比べると、情報の抜けへの強さや、情報を取りに行く振る舞いには大きな差があったと報告しています。

AIが専門用語を使わずに書いた解説です。内容の正確さは、下の原文の要旨で確認してください。

ABSTRACT / 要旨(原文)

Tool-using language model agents rely on environmental facts to decide whether an action is permitted. When a tool response omits a safety-relevant fact, an agent may carry out a prohibited action even though the user request is benign and every returned statement is true. We introduce \bench{}, an executable benchmark for evaluating unsafe execution, safety boundaries, and evidence recovery in LLM agents under missing evidence. It contains 300 matched unsafe/safe task pairs across six domains. By systematically suppressing critical facts, the benchmark measures unsafe execution under critical evidence omission and determines the minimum observed failure cardinality, including failures with full evidence and cases with no observed failure after exhaustive testing. An independent audit tool tests whether agents seek missing facts and then withhold prohibited actions while completing permissible tasks. The benchmark reveals substantial variation across the ten models in omission robustness, evidence acquisition, and appropriate action. Resistance to missing evidence does not necessarily translate into useful recovery. Recovery access reduces unsafe execution for all ten models, but agents differ in whether they actively obtain the missing facts and use them to act appropriately in both worlds.

ここに表示しているのは原論文の要旨です。AIによる要約や解釈は含みません。

この論文を取り上げた記事