The Pushback Paradox: A Two-Probe Diagnostic for Language Model Compliance
Are language models compliant with user instructions? A model that always complies can be stopped but also exploited, while one that always resists can be neither exploited nor stopped. We contribute an open two-probe benchmark that can place any language model on this spectrum. In the active probe, a user instructs the model to act and accept a lower payoff, which measures exploitability. In the passive probe, the user instructs it to wait and give up a higher payoff, which measures stoppability. The two compliance rates combine into a compliance index $κ$. Applied to twelve language models, the benchmark shows that seven mostly follow the instruction in both probes and justify their action by pointing to the instruction. Only Claude Sonnet-4.6 and Claude Opus-4.7 can be stopped without b
提出两探测基准评估语言模型的指令遵循度与可控制性。
- 核心方法
- 主动探测和被动探测结合，评估模型的可利用性和可停止性，通过两项合规率综合成合规指数$κ$。
- 适合谁读
- 适合AI研究者、工程师以及关心模型安全性和可控性的人阅读。
- 要解决的问题
- 解决语言模型对用户指令的遵循程度及防止被恶意利用的问题。
- 关键实验
- 对12个语言模型进行了测试，结果显示7个模型在两个探测中大多遵循指令并能合理解释行为，只有Claude Sonnet-4.6和Claude Opus-4.7模型能被有效停止。
- 主要贡献
- 提供了一个开放的两探针基准测试，能够量化评估不同语言模型的合规性。
- 意义与局限
- 该研究为评估语言模型的安全性和可控性提供了一个新的工具，有助于理解模型的行为模式；但仅测试了12个模型，可能不完全代表所有模型。