Win by Silence: Deletion Non-Monotonicity, Autonomous Exploitation, and Typed-State Gating in LLM Plan Evaluation· 沉默中取胜:大模型计划评估的删除非单调性等
Plan evaluators can reward a strategic plan for becoming less explicit. This paper studies that failure in a staged expected-value scorer for LLM-generated venture routes. Proposition 1 gives the score change from deleting an interior transition while retargeting its predecessor and retaining downstream value: Delta_k = (prod_{i<k} p_i)[c_k + (1 - p_k)R_{k+1}]. On a frozen 26-route cohort, all 57 admissible deletions matched the analytic identity and threshold sign, and every route had at least one score-improving deletion. A score-seeking optimizer, allowed to restructure routes but not told the exploit mechanism, found baseline-beating uncovered structures in 21/26 routes. GATE refused score release for 26/26 silenced routes with 0/26 honest suspensions; after refusal, 47/54 next revisions repaired to a covered structure, and strict covered improvement rose from 1/26 to 13/26. An adaptive compiler-aware co-author exposed the registry-provenance boundary: obligation-channel evasions remained 6/6 across all four v1/v1.5 conditions, while delta-indexed cost floors reduced beat-honest routes from 6/6 to 3/6 and fundability-by-silence from 5/6 to 0/6 without establishing semantic completeness. If a plan scores better only because it omits necessary work, the plan did not improve; the evaluation created an omission incentive. PCSC detects and neutralizes post-hoc omission splices over model-mediated typed-state records. In the cooperative setting tested, GATE acts as a deterministic search-shaping constraint, not merely a post-hoc filter. It does not verify the semantic completeness or real-world quality of arbitrary LLM-generated strategies.
研究大模型计划评估的非单调性问题及解决方案
- 核心方法
- 通过删除内部转换并重新定向前驱节点来分析评分变化,引入GATE机制抑制非单调性激励
- 适合谁读
- 研究者、工程师
- 要解决的问题
- 大模型生成的计划在评估时因非单调性而可能因省略必要步骤而得分更高
- 关键实验
- 在26个固定路线样本中,57次可接受的删除操作均符合分析结果;GATE拒绝了所有26次沉默操作,后续修订中有47次修复了覆盖结构,严格改进从1/26提高到13/26
- 主要贡献
- 提出GATE机制有效检测并抑制计划评估中的非单调性问题,提高计划的覆盖性和评分质量
- 意义与局限
- 提高了大模型生成计划的评估准确性和可靠性,减少了战略性省略导致的评分偏差;但不验证语义完整性和现实质量