ai.hackcv
论文精选 65arXiv

Interpretable Adaptive Sampling for LLM Test-Time Scaling· LLM测试时自适应缩放

Test-time scaling improves LLM reasoning by generating and aggregating multiple candidate answers, yet many pipelines use fixed per-query budgets that spend the same compute on easy and difficult prompts. These fixed budgets are also difficult to inspect because they do not explain why a given prompt receives a particular number of samples. We propose adaptive} test-time scaling with a lightweight fuzzy controller that maps interpretable signals, including estimated prompt complexity and model confidence, to a per-query sampling budget. The controller assigns fewer samples to easier or more confident prompts and more samples to harder or less certain prompts, making inference-time compute inspectable rather than fixed or opaque. We evaluate under a fair-alignment protocol with matched deco

AI 解读论文

提出一种可解释的自适应采样策略,优化LLM推理效率和成本

核心方法
通过轻量模糊控制器,根据提示复杂度和模型置信度自适应调整每查询的样本数量
适合谁读
研究者、工程师
要解决的问题
现有测试时缩放方法使用固定的每查询预算,不论任务难易度,导致资源浪费
关键实验
在公平对齐协议下进行了评估,但实验数据部分匹配
主要贡献
提供了一种更加灵活且可解释的测试时缩放方法,能够动态优化资源分配
意义与局限
有助于提高大型语言模型在推理阶段的资源利用效率,减少计算成本,但仍需进一步验证其广泛应用的有效性
领域:cs.AI作者:Mobina Kashaniyan、Ali Jannesari
相关推荐

本站内容由 LLM 精选聚合,原文版权归 arXiv 所有 · 摘录仅供参考