External Observers May See More Clearly: Cross-Model Span-Level Hallucination Detection in Large Language Models via Hidden State Probing· 外部观察者可能更清楚:大语言模型的跨模型片段级幻觉检测
As Large Language Models (LLMs) increasingly serve as foundational reasoning engines, their tendency to hallucinate remains a critical vulnerability. While recent internal state probes offer a promising alternative to slow external retrieval systems, they largely reduce hallucination detection to a token-wise binary classification task, failing to capture the structured, sequential boundaries of semantic drift. Here, we introduce an internal hidden state framework for fine-grained, span-level hallucination detection. By inspecting layer-wise activation patterns, we attempt to detect the exact hallucination onset and continuation tokens in an LLM generation. Our experiments show that this approach successfully isolates hallucination onsets, achieving substantial improvements in Precision-Re
通过隐藏状态探测实现大语言模型的跨模型片段级幻觉检测。
- 核心方法
- 提出一种内部隐藏状态框架,通过分析逐层激活模式来精确定位幻觉的起始和延续标记。
- 适合谁读
- 研究者、工程师
- 要解决的问题
- 解决大语言模型生成文本时出现的片段级幻觉问题。
- 关键实验
- 实验表明该方法能够有效隔离幻觉起始点,显著提升了检测的精准度。
- 主要贡献
- 实现了更细粒度的幻觉检测,改进了精确度和召回率。
- 意义与局限
- 此研究有助于提高大语言模型的可靠性和准确性,但可能对计算资源有较高要求。