ai.hackcv
论文精选 82arXiv

Decoding-Level Taboo: A Diagnostic Stress Test for LLM Robustness· 解码级禁忌:大模型鲁棒性的诊断压力测试

Large language model evaluations typically focus on performance under nominal conditions, creating an illusion of capability where models comfortably walk a narrow, highly optimized generation corridor. In real-world deployments, however, complex system prompts, safety guardrails, and structural constraints continuously force models off this nominal path, driving a divergence between benchmark scores and deployment performance. To address this issue, we introduce Decoding-Level Taboo, a zero-prompt diagnostic stress test that intervenes directly in logit space at runtime, forcing models out of their nominal paths. By dynamically masking primary candidate tokens at word boundaries, Taboo forces machine circumlocution. Evaluating Taboo across several open-weight model families reveals that o

领域:cs.CL作者:Tadanobu Chuyo Kamijo、Ori Rottenstreich、Javier Conde
相关推荐

本站内容由 LLM 精选聚合,原文版权归 arXiv 所有 · 摘录仅供参考