ai.hackcv
论文精选 65arXiv

Co-Evolving Harnesses and Models: On-Policy Correction Helps Weaker Models Catch Up Where Imitation Fails· 共进化的模型与框架

Agent harnesses (the system prompt, tool set, execution hooks, and context-management scaffolding around a model) are a critical determinant of agentic task success. Automated harness evolution can enable smaller models to perform well on domain-specific tasks at a fraction of frontier-model cost. Since both the harness and model weights shape behavior, we ask how harness evolution and lightweight fine-tuning should be combined. Across seven enterprise agent tasks, we first evolve a harness with the weaker model, then find that a stronger expert often uses it more effectively, suggesting expert supervision could close the remaining gap. However, training the weaker model on the expert's complete trajectories under the evolved harness backfires: performance regresses on all seven tasks by 4

AI 解读论文

共进化的框架与模型,使弱模型在特定任务上超越模仿

核心方法
首先使用弱模型进化代理框架,然后利用专家模型的有效使用来监督弱模型的微调,而不是直接模仿专家的完整轨迹
适合谁读
研究者 / 工程师
要解决的问题
如何结合模型权重调优和代理框架进化,使小型模型在特定任务上达到与大型模型相媲美的性能
关键实验
在七项企业级代理任务上进行了实验,展示弱模型在经过框架进化后的表现
主要贡献
证明了共进化的代理框架可以显著提高小型模型的性能,且在某些情况下超越直接模仿
意义与局限
该研究为减少模型成本和提高小模型性能提供了新的思路,但同时也揭示了完全模仿专家模型可能带来性能下降的问题
领域:cs.AI作者:Zhou Yu、Bin Bi、Shiva Kumar Pentyala
相关推荐

本站内容由 LLM 精选聚合,原文版权归 arXiv 所有 · 摘录仅供参考