SAGE: Mitigating Long-Horizon Reasoning Biases via Topological Guidance· SAGE:通过拓扑引导缓解长期推理偏差
Long-horizon reasoning remains a central challenge for large language models (LLMs) under sparse-reward regimes. We argue that this brittleness arises from two biases induced by complex reasoning spaces: an exploration bias, where models are drawn toward locally plausible but structurally unstable branches, and a compounding bias, where small local deviations accumulate across depth and suppress rare rewards. We introduce Symbolic Closure Analysis (SCA) as a theoretical lens characterizing how branching structures and sparse rewards induce these biases in long-horizon reasoning with local admissibility, and as a design principle for structural priors in less formal reasoning tasks. Motivated by this analysis, we propose SAGE (Structural Admissibility-Guided Exploration), a unified framewor
通过拓扑引导方法缓解大语言模型在长期推理中的偏差。
- 核心方法
- 提出Symbolic Closure Analysis (SCA)作为理论工具,分析长期推理中的偏差来源,进而设计SAGE框架,利用结构先验引导模型探索。
- 适合谁读
- 研究者 / 工程师
- 要解决的问题
- 大语言模型在稀疏奖励环境下进行长期推理时存在探索偏差和累积偏差,导致推理不稳定。
- 关键实验
- 未提供
- 主要贡献
- 引入SCA理论分析长期推理的偏差机制,并提出SAGE框架来缓解这些偏差,提高大语言模型在稀疏奖励环境下的推理能力。
- 意义与局限
- SAGE框架有望改善大语言模型在复杂推理任务中的表现,但其实际效果和适用范围仍需进一步验证。