Can We Break LLMs Out of Self-Loops? Fine-Grained Reasoning Control with Activation Steering· 如何打破大模型自循环?
Extended reasoning has become standard for frontier Large Language Models (LLMs), yet the trajectories these models produce remain largely uncontrollable. Existing methods for shaping how a model reasons are prompt based approaches and operate at the input level, offering no fine-grained control over the reasoning process itself. Related work analyzes and discovers latent transition dynamics in the reasoning traces from Large Language Models. Building on this, we statistically characterize these states, and show that failure trajectories get stuck in self-loops, exhausting the token budget without progress toward the final answer. To intervene on these failures, We propose SOPHIA: Steering Of reasoning Processes via Hidden-state Intervention and Activations. We treat each reasoning trace a
提出一种新方法 SOPHIA 通过干预隐状态和激活来控制大模型的推理过程
- 核心方法
- SOPHIA方法通过统计分析推理过程中的隐藏状态,识别并调整陷入自循环的推理路径,实现对模型推理过程的细粒度控制
- 适合谁读
- 研究者 / 工程师
- 要解决的问题
- 大语言模型在进行长链推理时容易陷入自循环中,无法有效利用Token预算完成推理任务
- 关键实验
- 通过在数学问题、逻辑推理等任务上的实验,展示了SOPHIA能够显著减少自循环现象,提高模型解决问题的效率
- 主要贡献
- 提供了首个能够干预大语言模型内部推理状态,防止自循环的技术方案
- 意义与局限
- 此方法可提升大模型在复杂任务上的性能,但需要进一步研究其对不同任务类型的普适性