ai.hackcv
论文精选 65arXiv

What Can Component-Replacement Evidence Establish? A Critical Scoping Review of Local Decisions in LLM Agents· LLM 组件替换证据能确定什么?

Background. A component replacement in a language-model agent changes an execution trajectory, potentially altering later observations, resource use, and recovery opportunities. Different evidence is needed to assess its task-level benefit and the contribution of local decision quality. Methods. This critical scoping review maps 348 studies and examines 90 comparison records: 88 from 40 included studies and two from supplementary studies. Eight purposively selected cases structure the synthesis around the replaced decision, executed conditions, measurement comparability, controls, and remaining explanations. Results. Of 222 studies reporting local decision metrics, 142 also report measured task endpoints and 49 report proxies. These counts identify studies that report both types of measure

AI 解读论文

审查LLM组件替换对局部决策质量与任务级效果的影响

核心方法
通过关键综述,分析348项研究并审查90个对比记录,探讨组件替换后决策、执行条件、测量可比性、控制情况及剩余解释
适合谁读
研究者
要解决的问题
评估语言模型代理中组件替换对任务表现及局部决策质量的具体影响
关键实验
未提供
主要贡献
明确了报告局部决策度量与任务端点度量的研究数量,为评估LLM组件替换效果提供了参考
意义与局限
为研究LLM代理中的组件替换效应提供了结构化的分析框架,影响模型优化策略,但未深入探讨具体技术实现
领域:cs.AI作者:Shuyang Zhang、Jianshuo Chang
相关推荐
论文精选 65已解读

Simulated Control Evals· 模拟控制评估

Control evaluations measure whether safeguards can prevent an AI model from causing undesi…

领域:cs.AI作者:Jeffrey Olmo、David Zhang、Tyler Tracy
📎 arXiv🕒 10-23 01:26🔗 arxiv.org

本站内容由 LLM 精选聚合,原文版权归 arXiv 所有 · 摘录仅供参考