Deep Interaction: An Efficient Human-AI Interaction Method for Large Reasoning Models· 深层互动:大型推理模型的有效人机互动方法
The emergence of Chain-of-Thought (CoT) reasoning has significantly enhanced the ability of large language models (LLMs) to tackle complex, multi-step tasks. However, when errors occur, current interaction approaches typically involve re-generating another response that may make mistakes again, or users laboriously flag the faulty step in follow-up turns that may get responses followed by similar errors recurring. To address this issue, we propose an efficient human intervention mechanism for precisely correcting reasoning errors in LLMs, termed Deep Interaction. Our approach enables direct editing of the original response, allowing erroneous parts to be corrected while preserving accurate reasoning steps. We refine the edited CoT into a distilled prompt, which then steers the LLM along the corrected reasoning path. Experimental results show that our method achieves over a 25% improvement in correction success rate and reduces token usage by approximately 40% on STEM tasks reasoning compared to baseline approaches.
提出一种有效的人机互动机制,以精确纠正大型语言模型的推理错误。
- 核心方法
- 设计了一种称为Deep Interaction的方法,允许直接编辑模型的原始响应,通过精炼编辑后的Chain-of-Thought作为引导提示,使模型遵循纠正后的推理路径。
- 适合谁读
- 研究者、工程师
- 要解决的问题
- 当前的人机互动方法在纠正大型语言模型的推理错误时效率低下,容易重复错误。
- 关键实验
- 在STEM任务推理上进行了实验,对比了基线方法,展示了Deep Interaction方法的优势。
- 主要贡献
- 方法显著提高了纠错成功率(超过25%),同时减少了约40%的token使用量,特别是在STEM任务的推理上。
- 意义与局限
- 此方法提高了人机交互的有效性和效率,减少了用户的操作负担,但可能对非STEM领域任务的有效性需要进一步验证。