Towards Zero-Shot Task Transfer with Neurosymbolic World Models· 迈向零样本任务迁移的神经符号世界模型
State-of-the-art model-based reinforcement learning methods learn neural world models that allow policy improvement by planning in a latent space, without assumptions on the structure of the underlying environment. While expressive, these models are generally task-dependent: they learn uninterpretable latent representations that are tied to the training task and thus hard to generalize to new tasks. In this work, we present a novel world model formulation where the reward prediction only depends on a subset of structured, symbolic components of the whole latent state. Decoupling observation reconstruction and reward prediction allows us to learn world models that can adapt zero-shot, i.e. without further environment interactions, to new reward functions defined over the same symbolic state
提出神经符号世界模型,实现零样本任务迁移。
- 核心方法
- 引入了一个新的世界模型框架,其中奖励预测仅依赖于整个潜在状态中的一小部分结构化、符号化组件,解耦了观察重建和奖励预测。
- 适合谁读
- 研究者
- 要解决的问题
- 现有的基于模型的强化学习方法虽然可以学习神经世界模型,但这些模型通常与特定任务绑定,难以推广到新任务。
- 关键实验
- 未提供
- 主要贡献
- 实现了无需进一步环境交互即可适应新奖励函数的零样本任务迁移。
- 意义与局限
- 该方法在理论上突破了任务依赖性的限制,对于推动强化学习在更广泛场景中的应用具有重要意义,但实际效果和应用范围仍需进一步验证。