ai.hackcv
论文精选 65arXiv

Towards Zero-Shot Task Transfer with Neurosymbolic World Models· 迈向零样本任务迁移的神经符号世界模型

State-of-the-art model-based reinforcement learning methods learn neural world models that allow policy improvement by planning in a latent space, without assumptions on the structure of the underlying environment. While expressive, these models are generally task-dependent: they learn uninterpretable latent representations that are tied to the training task and thus hard to generalize to new tasks. In this work, we present a novel world model formulation where the reward prediction only depends on a subset of structured, symbolic components of the whole latent state. Decoupling observation reconstruction and reward prediction allows us to learn world models that can adapt zero-shot, i.e. without further environment interactions, to new reward functions defined over the same symbolic state

AI 解读论文

提出神经符号世界模型,实现零样本任务迁移。

核心方法
引入了一个新的世界模型框架,其中奖励预测仅依赖于整个潜在状态中的一小部分结构化、符号化组件,解耦了观察重建和奖励预测。
适合谁读
研究者
要解决的问题
现有的基于模型的强化学习方法虽然可以学习神经世界模型,但这些模型通常与特定任务绑定,难以推广到新任务。
关键实验
未提供
主要贡献
实现了无需进一步环境交互即可适应新奖励函数的零样本任务迁移。
意义与局限
该方法在理论上突破了任务依赖性的限制,对于推动强化学习在更广泛场景中的应用具有重要意义,但实际效果和应用范围仍需进一步验证。
领域:cs.AI作者:Isidoro Tamassia、Lennert De Smet、Giuseppe Marra
相关推荐

本站内容由 LLM 精选聚合,原文版权归 arXiv 所有 · 摘录仅供参考