RoboJEPA: Scaling Robotic Latent World Models· RoboJEPA:机器人潜在世界模型的扩展
Latent world models have shown a remarkable ability to predict future states and to plan in the real world. In practice, however, we lack a principled way to estimate how their capabilities scale with model size, data, and compute, an open problem that slows progress in the field. In this work we present RoboJEPA, a world model based on the Joint Embedding Predictive Architecture (JEPA) and trained on a large-scale dataset spanning 12 robotic embodiments. We show that RoboJEPA's imagination error, the error of its latent rollouts, follows a second-order power law in compute, allowing us to predict model quality well beyond the scale at which the law is fit. We further show that downstream robotic planning performance improves predictably with compute, and that imagination error is strongly
扩展的机器人潜在世界模型预测性能随计算资源增长
- 核心方法
- 提出RoboJEPA模型,基于JEPA架构,使用12种机器人体形式的大规模数据集训练,分析想象误差与计算资源的关系
- 适合谁读
- 研究者 / 工程师
- 要解决的问题
- 缺乏评估机器人潜在世界模型能力如何随模型大小、数据量和计算资源扩展的理论方法
- 关键实验
- 在不同计算资源条件下测试了模型的想象误差和下游规划任务的性能
- 主要贡献
- 证明了RoboJEPA的想象误差与计算资源之间存在二次幂律关系,可预测模型性能
- 意义与局限
- 为机器人潜在世界模型的性能评估和优化提供新方法,但可能受限于特定数据集和任务类型