SAVeR$^2$: Reasoning-based Safety Alignment for Large Reasoning Models via Verifiable Rewards
arXiv cs.AIen
arXiv:2611.07482v1 Announce Type: new Abstract: Large Reasoning Models (LRMs) have achieved impressive performance via explicit Chain-of-Thought (CoT) reasoning, yet this process introduces critical safety risks. We formalize LRM safety objectives as requiring non-malicious reasoning and answers, safety consistency, and explicit intent identification. We argue that existing alignment methods suffer from poor adversarial generalization, a significant ``safety tax'' on reasoning, and unfaithful coarse-grained rewards, primarily due to their neglect of the LRM's intrinsic reasoning capabilities for safety. To address these, we propose \textbf{SAVeR$^2$}, a novel \textbf{S}afety \textbf{A}lignme
This is a short summary published by AI Global Wire. The full article is owned and hosted by arXiv cs.AI — open it there to read it in full.
Read the full story at arXiv cs.AI- Forskning
Related AI news
- BlockLock: Reproducible LLM Inference with Fixed Batch GeometryarXiv cs.AI · November 6, 2026
- Align Before Aggregation: Basis-Consistent Federated LoRA under Heterogeneous RanksarXiv cs.AI · November 6, 2026
- KDASO: Knowledge-Data Dual-Driven Automated Skill Optimization for Liability Adjudication TasksarXiv cs.AI · November 6, 2026
- Adapting the Process of Adaptation: Darwinian, Lamarckian, and Agent-Directed Evolution in AIarXiv cs.AI · November 6, 2026
- Graph learning-assisted logic-based Benders decomposition for distributionally robust in-station train rescheduling under disruptionsarXiv cs.AI · November 6, 2026
- Goal-Branching LaCAM: Temporary Goals as Search Branches in Dense Multi-Agent PathfindingarXiv cs.AI · November 6, 2026