DreamTrue: Action-Faithful Robot World Model with Counterfactual Post-Training· DreamTrue: 基于反事实后训练的动作忠实机器人世界模型
We present DreamTrue, a multi-view, cross-embodiment robot world model for action-faithful and physically plausible video prediction. Training such a model on existing robot datasets faces two obstacles: imprecise calibration can impair action following, while limited coverage of unsuccessful interactions can bias predictions toward successful outcomes. To improve action following across embodiments, we render action trajectories into image-space conditions and introduce offline geometric calibration to align these conditions with the target videos. To broaden interaction coverage, we introduce counterfactual post-training, modifying recorded action trajectories and generating future videos under a wider range of actions and contact configurations. To provide feedback on these predictions without paired ground-truth futures, we construct a human-annotated video dataset covering robot, object, and interaction defects and use it to train an embodied video reward model. Its scores guide reinforcement-learning post-training toward more physically plausible interaction outcomes. On AgiBot, DreamTrue attains state-of-the-art action following, while reducing the human-assessed interaction defect rate from from 48.12% to 6.25%. Notably, our model ranks first in the world model track of the AgiBot World Challenge 2026. The project page can be found at https://brave-eai.github.io/DreamTrue.
提出DreamTrue,增强机器人动作忠实性和物理可信度的视频预测模型。
- 核心方法
- 采用多视角、跨实体的方法,通过反向渲染动作轨迹、离线几何校准和反事实后训练改进模型,使用人类注释的缺陷视频数据集指导强化学习后训练。
- 适合谁读
- 适合机器人研究者、工程师和产品开发人员阅读
- 要解决的问题
- 现有机器人数据集中的不精确校准和有限的失败交互记录导致动作忠实性和物理合理性预测不佳。
- 关键实验
- 在AgiBot上的实验显示,DreamTrue将人类评估的交互缺陷率从48.12%降至6.25%,并在世界模型赛道中排名第一。
- 主要贡献
- 在AgiBot上实现最先进的动作跟随效果,并显著降低人类评估的交互缺陷率,成为2026年AgiBot世界挑战赛世界模型赛道冠军。
- 意义与局限
- 提高了机器人在复杂环境中的动作计划和执行能力,但可能受限于特定数据集和场景的人类注释。