PAMD: Structured Adaptive Distances for Bisimulation Representations in Visual Reinforcement Learning· PAMD:用于视觉强化学习的两两自适应马氏距离
Many visual reinforcement learning (RL) algorithms learn representations by matching latent distances to a behavioral distance induced by reward and transition similarity. In practice, the choice of the latent distance can strongly affect performance: using a fixed, pre-specified global norms (e.g., $\ell_p$ norms or other hand-designed metrics) may be overly restrictive to capture the behavioral distance. In contrast, unconstrained pairwise distances may admit degenerate solutions that drive the metric loss down without improving the representation. To address this gap, we introduce **PAMD: Pairwise Adaptive Mahalanobis Distance**, which parameterizes a positive-definite, pair-conditioned metric for measuring latent state similarity. PAMD is a simple plug-in for existing bisimulation-base
自适应马氏距离提升视觉强化学习表示的性能。
- 核心方法
- PAMD 参数化了一个正定的、条件化的马氏距离,用于衡量潜在状态的相似性,作为现有两两模拟距离度量方法的插件。
- 适合谁读
- 研究者
- 要解决的问题
- 视觉强化学习中,固定的全局距离度量过于限制,而无约束的两两距离可能导致退化解。
- 关键实验
- 未提供
- 主要贡献
- 提供了一种新的距离度量方法 PAMD,能够更好地捕捉行为距离,改善视觉强化学习中的表示学习。
- 意义与局限
- PAMD 有望提高视觉强化学习算法的性能,但其实际应用效果需要进一步实验验证。