ai.hackcv
论文精选 65arXiv

OpenForgeRL: Train Harness-native Agents in Any Environment· OpenForgeRL:在任何环境中训练 Harness 原生代理

Modern AI agents rely on elaborate inference harnesses such as Claude Code, Codex, and OpenClaw to drive multi-turn reasoning, tool use, and access to external systems. While powerful, these complex harnesses also make agents hard to train end-to-end with open infrastructure, whose SFT/RL stacks cannot natively express stateful, multi-process harness inference. To address this, we present OpenForgeRL, an open-source framework for training harness-based agents end-to-end in diverse environments. OpenForgeRL achieves this with a lightweight proxy that serves the harness's model calls while recording them as training data for a standard RL codebase (e.g., veRL), and a Kubernetes orchestrator that runs each rollout in its own remote container, together enabling training on any harness in any e

AI 解读论文

开放源代码框架,支持在任何环境中端到端训练复杂的多进程代理。

核心方法
通过轻量级代理记录模型调用作为训练数据,并使用Kubernetes编排器在远程容器中运行每个rollout,从而支持在标准RL代码库中训练。
适合谁读
研究者 / 工程师
要解决的问题
现代AI代理依赖于复杂的推理框架,这些框架使得代理难以使用开放的基础架构进行端到端训练。
关键实验
未提供
主要贡献
提供了一个开放源代码框架OpenForgeRL,可以端到端训练基于推理框架的代理,适用于多样的环境。
意义与局限
OpenForgeRL能够降低复杂代理的训练门槛,可能推动AI代理在更多领域的应用,但其有效性和广泛适用性仍需进一步验证。
领域:cs.AI作者:Xiao Yu、Baolin Peng、Ruize Xu
相关推荐

本站内容由 LLM 精选聚合,原文版权归 arXiv 所有 · 摘录仅供参考