SHIRITAS

論文 / arXiv:2610.12432

FAITH: Feasibility-Aware Safety-Filtered RL for High-Dimensional Systems

PLAIN SUMMARY / やさしい要約

ロボットに「安全に動くこと」と「うまく仕事をすること」を同時に教えると、両者がぶつかることがあります。FAITHは、ロボットが動く直前に“安全チェック”を入れて、危ない動きだけをできるだけ小さく修正する考え方です。しかも、その安全チェックを事前に数式で用意しなくても、学習で作れると述べています。たとえるなら、運転そのもの(目的地へ早く行く)と、直前の衝突回避(危ないときだけ少しハンドルを切る)を分けるイメージです。

AIが専門用語を使わずに書いた解説です。内容の正確さは、下の原文の要旨で確認してください。

ABSTRACT / 要旨(原文)

Safe reinforcement learning commonly places safety and task performance in the same policy objective, where they can introduce competing updates. Safety filters separate them at action execution, but classical designs require an analytic safety function and dynamics model, and standard minimal-intervention filters are myopic to long-horizon task return because they minimize only instantaneous action deviation. Hard projections are also undefined when no safe action exists. We present FAITH, a feasibility-aware, model-free framework that approximates the optimal state-action safety value and amortizes minimal-intervention filtering with a feedforward network. The task policy optimizes the task return through the filtered dynamics, which recovers the feasible constrained problem without a competing safety term in the task-policy update. When no action satisfies the learned safety condition, the same filter approaches the action with minimum predicted peak harm. On a double integrator example and a Safety Gym environment, FAITH achieves the highest return among methods with no feasible-start violations and matches the lowest harm from infeasible starts. On a 29-DoF humanoid, it reaches a 99.95% safety rate while retaining 97% of the unfiltered return in Walking-Avoid, and obtains the highest measured safety rate in Push-Avoid by learning to sacrifice balancing and fall away from the protected region. The same policies are also demonstrated on a real-world Unitree G1 humanoid.

ここに表示しているのは原論文の要旨です。AIによる要約や解釈は含みません。

この論文を取り上げた記事