Interpretable Adaptive Sampling for LLM Test-Time Scaling· LLM测试时自适应缩放
Test-time scaling improves LLM reasoning by generating and aggregating multiple candidate answers, yet many pipelines use fixed per-query budgets that spend the same compute on easy and difficult prompts. These fixed budgets are also difficult to inspect because they do not explain why a given prompt receives a particular number of samples. We propose adaptive} test-time scaling with a lightweight fuzzy controller that maps interpretable signals, including estimated prompt complexity and model confidence, to a per-query sampling budget. The controller assigns fewer samples to easier or more confident prompts and more samples to harder or less certain prompts, making inference-time compute inspectable rather than fixed or opaque. We evaluate under a fair-alignment protocol with matched deco
提出一种可解释的自适应采样策略,优化LLM推理效率和成本
- 核心方法
- 通过轻量模糊控制器,根据提示复杂度和模型置信度自适应调整每查询的样本数量
- 适合谁读
- 研究者、工程师
- 要解决的问题
- 现有测试时缩放方法使用固定的每查询预算,不论任务难易度,导致资源浪费
- 关键实验
- 在公平对齐协议下进行了评估,但实验数据部分匹配
- 主要贡献
- 提供了一种更加灵活且可解释的测试时缩放方法,能够动态优化资源分配
- 意义与局限
- 有助于提高大型语言模型在推理阶段的资源利用效率,减少计算成本,但仍需进一步验证其广泛应用的有效性