SHIRITAS

論文 / arXiv:2611.24936

Jailbreak Detection on Large Language Models via Contrastive Prototype Structures

PLAIN SUMMARY / やさしい要約

大規模言語モデルには、危険な指示を通そうとする入力を見分ける工夫が求められます。この研究は、追加の判定用モデルを別に作らず、最小限の「安全/危険」という印だけで見分ける方法を提案します。やり方は、危険な文と安全な文それぞれの“代表例”を作り、入力がどちらに近いかで判断するというものです。たとえるなら、2つの見本(安全の見本と危険の見本)を用意して、持ち込まれた文章がどちらの見本に似ているかを測るイメージです。

AIが専門用語を使わずに書いた解説です。内容の正確さは、下の原文の要旨で確認してください。

ABSTRACT / 要旨(原文)

Jailbreak attempts and harmful prompts remain a challenge for the safe deployment of large language models. We study whether contrastively learned representations can support safety detection without training an additional downstream classifier. We propose Jailbreak Detection with Prototype Inference (JDPI), which uses binary safety labels to construct harmful and benign prototypes and makes predictions from relative prototype distances. JDPI uses only binary safety labels for encoder adaptation, prototype construction, and validation. In our setup, it uses fewer labeled examples than the classifier baseline (Method A) by avoiding the separate split used to train the downstream classifier. Across four benchmarks covering different input formats, contrastive fine-tuning improves JDPI's detection accuracy by 9.1-18.0 percentage points. Using the same encoder, JDPI achieves slightly higher ROC-AUC on one benchmark and stays within 0.017 of the baseline across all four. With dataset-specific adaptation, JDPI exceeds the released Llama Guard 3-8B baseline by 0.173-0.310 in ROC-AUC across the four benchmarks. In multi-turn replay on TomGibbs, JDPI uses accumulated user history as the conversation unfolds, achieving higher conversation-level accuracy than when it uses the current turn alone. Across 12 directed transfers, JDPI outperforms the classifier by an average of 1.59 percentage points in accuracy, demonstrating stronger cross-dataset robustness.

ここに表示しているのは原論文の要旨です。AIによる要約や解釈は含みません。

この論文を取り上げた記事