Co-Evolving Harnesses and Models: On-Policy Correction Helps Weaker Models Catch Up Where Imitation Fails· 共进化的模型与框架
Agent harnesses (the system prompt, tool set, execution hooks, and context-management scaffolding around a model) are a critical determinant of agentic task success. Automated harness evolution can enable smaller models to perform well on domain-specific tasks at a fraction of frontier-model cost. Since both the harness and model weights shape behavior, we ask how harness evolution and lightweight fine-tuning should be combined. Across seven enterprise agent tasks, we first evolve a harness with the weaker model, then find that a stronger expert often uses it more effectively, suggesting expert supervision could close the remaining gap. However, training the weaker model on the expert's complete trajectories under the evolved harness backfires: performance regresses on all seven tasks by 4
共进化的框架与模型,使弱模型在特定任务上超越模仿
- 核心方法
- 首先使用弱模型进化代理框架,然后利用专家模型的有效使用来监督弱模型的微调,而不是直接模仿专家的完整轨迹
- 适合谁读
- 研究者 / 工程师
- 要解决的问题
- 如何结合模型权重调优和代理框架进化,使小型模型在特定任务上达到与大型模型相媲美的性能
- 关键实验
- 在七项企业级代理任务上进行了实验,展示弱模型在经过框架进化后的表现
- 主要贡献
- 证明了共进化的代理框架可以显著提高小型模型的性能,且在某些情况下超越直接模仿
- 意义与局限
- 该研究为减少模型成本和提高小模型性能提供了新的思路,但同时也揭示了完全模仿专家模型可能带来性能下降的问题