論文 / arXiv:2610.20609
SafeDriveVLA: Navigation-Conditioned World Model Dreaming for Conflict-Aware End-to-End Autonomous Driving
PLAIN SUMMARY / やさしい要約
自動運転に言葉で道案内できるようになると、うっかり危ない指示を出したり、わざと危ない指示を出したりする問題が出てきます。研究者らは、指示に従う力だけでなく「その指示は安全と矛盾していないか」を同時に確かめるための評価セットを提案しました。さらに、安全とぶつかる可能性があるかを先に見分けてから運転操作を作るモデルを提案しています。たとえるなら、目的地までの案内をそのまま実行する前に「その道順は今の状況で危なくないか」を一度確認してから動く、という発想です。
AIが専門用語を使わずに書いた解説です。内容の正確さは、下の原文の要旨で確認してください。
ABSTRACT / 要旨(原文)
Vision-Language-Action (VLA) models are gaining attention in autonomous driving, inheriting commonsense priors from large language models (LLMs) and widening the navigation interface from a fixed command set to free-form natural-language instructions. However, this open-ended interface exposes a new vulnerability surface: an inattentive driver may issue instructions that are unsafe given the current scene, and a malicious user may issue dangerous ones on purpose. We present the first benchmark suite that evaluates navigation following and conflict awareness together, along with adversarial robustness. Existing VLAs fall short on both: SimLingo completes no language-instructed lane change in closed loop, and all models degrade sharply under conflicting signals. We propose SafeDriveVLA, the first driving VLA that (1) explicitly predicts a three-level navigation-compliance mode to decouple conflict reasoning from action generation, and (2) uses navigation-conditioned world model dreaming to inform this prediction. Unlike prior world models that roll out expert or planned actions, ours dreams of strictly following the navigation signal, showing when following is safe. SafeDriveVLA reaches 88.16 Driving Score (DS) and 68.64% Success Rate (SR) on Bench2Drive, lifts closed-loop language following by 49.3% and reduces collisions under unsafe instructions from 60 to 38 compared to the best SimLingo variant. Video demonstrations are available on our project page.
ここに表示しているのは原論文の要旨です。AIによる要約や解釈は含みません。
