ai.hackcv
论文精选 83arXiv

ShallowDefend: Harnessing Shallow Safety Alignment for Multi-Turn Defender

Safety alignment has enabled large language models to reliably refuse harmful requests directly, yet the same request distributed across a multi-turn conversation still succeeds far too often. This brittleness has a mechanistic root: Alignment is shallow, with safety behavior concentrated in a model's first few output tokens, and existing defenses inherit the weakness, supervising the surface form of the response without ever giving the model an explicit safety decision to learn. We take the opposite view of shallowness: if a short span determines the trajectory of an entire response, that span is the highest-leverage place to intervene, and the defender can occupy it first. We propose Assess $\to$ Decide $\to$ Respond, a framework in which the defender assesses the user's intent, commits

领域:cs.CL作者:Qiyao Ma、Xiaodong Liu、Weiwei Yang
相关推荐
论文精选 82

Elucidating the Design Space of LM Data Attribution· 阐明大模型数据归属的设计空间

Data attribution methods for Language Models (LMs) are typically evaluated using downstrea…

领域:cs.CL作者:Steven Yu、Sheng-Yu Wang、Kimia Hamidieh
📎 arXiv🕒 10-30 01:59🔗 arxiv.org

本站内容由 LLM 精选聚合,原文版权归 arXiv 所有 · 摘录仅供参考