OpenForgeRL: Train Harness-native Agents in Any Environment· OpenForgeRL:在任何环境中训练 Harness 原生代理
Modern AI agents rely on elaborate inference harnesses such as Claude Code, Codex, and OpenClaw to drive multi-turn reasoning, tool use, and access to external systems. While powerful, these complex harnesses also make agents hard to train end-to-end with open infrastructure, whose SFT/RL stacks cannot natively express stateful, multi-process harness inference. To address this, we present OpenForgeRL, an open-source framework for training harness-based agents end-to-end in diverse environments. OpenForgeRL achieves this with a lightweight proxy that serves the harness's model calls while recording them as training data for a standard RL codebase (e.g., veRL), and a Kubernetes orchestrator that runs each rollout in its own remote container, together enabling training on any harness in any e
开放源代码框架,支持在任何环境中端到端训练复杂的多进程代理。
- 核心方法
- 通过轻量级代理记录模型调用作为训练数据,并使用Kubernetes编排器在远程容器中运行每个rollout,从而支持在标准RL代码库中训练。
- 适合谁读
- 研究者 / 工程师
- 要解决的问题
- 现代AI代理依赖于复杂的推理框架,这些框架使得代理难以使用开放的基础架构进行端到端训练。
- 关键实验
- 未提供
- 主要贡献
- 提供了一个开放源代码框架OpenForgeRL,可以端到端训练基于推理框架的代理,适用于多样的环境。
- 意义与局限
- OpenForgeRL能够降低复杂代理的训练门槛,可能推动AI代理在更多领域的应用,但其有效性和广泛适用性仍需进一步验证。