ai.hackcv
论文精选 65arXiv

Learning Meta-Skills for Agent Harness Design in Test-Time AI4AI· 测试时AI-for-AI的元技能学习

Agent performance depends on both reasoning ability and the environment in which it acts. We study test-time AI-for-AI, asking how a Builder can learn to construct better execution environments for a Target while both models' weights remain fixed. To make the Builder's experience reusable, we introduce Meta-Skill: principles specifying when support is needed and what resources to provide. The Builder learns these principles from Target's execution feedback on the development set, then uses the frozen skill bank to construct harnesses for unseen tasks. Across Harness-Bench and NewtonBench, full-bank meta-skills improve macro-average performance by 8.95 percentage points over no-skill construction, and 12.02 points over direct delivery of the same bank to the Target. These results highlight

AI 解读论文

学习元技能以优化代理在测试时的执行环境设计

核心方法
引入元技能概念,通过Target在开发集上的执行反馈来学习何时提供支持及提供哪些资源的原则
适合谁读
研究者
要解决的问题
探索如何在测试时通过AI为AI设计更优的执行环境,以提升代理性能
关键实验
在Harness-Bench和NewtonBench上验证,显示与无技能构建和直接交付相比,元技能有明显性能提升
主要贡献
提出了元技能学习框架,显著提升了代理在新任务上的平均性能
意义与局限
为AI测试环境的设计提供了新思路,但目前仅限于特定数据集上的验证
领域:cs.AI作者:Cheng Qian、Kunlun Zhu、Beibin Li
相关推荐
论文精选 65已解读

Simulated Control Evals· 模拟控制评估

Control evaluations measure whether safeguards can prevent an AI model from causing undesi…

领域:cs.AI作者:Jeffrey Olmo、David Zhang、Tyler Tracy
📎 arXiv🕒 10-23 01:26🔗 arxiv.org

本站内容由 LLM 精选聚合,原文版权归 arXiv 所有 · 摘录仅供参考