ai.hackcv
论文精选 60arXiv

Robust PAC Learning of Concurrent Stochastic Games· 并发随机游戏的鲁棒 PAC 学习

We introduce the first Probably Approximately Correct (PAC) learning framework for general-sum concurrent stochastic games (CSGs) with transition uncertainty, while addressing the challenge of Nash equilibrium (NE) existence. Our algorithm maintains data-driven $L^1$ confidence sets over transition kernels and solves a robust CSG to compute a social-welfare optimal $\varepsilon$-NE, using a robust MDP-based exploration mechanism to drive joint state-action coverage. Crucially, we introduce a Nash margin characterisation that enables principled reasoning about equilibrium existence: the framework either returns an $\varepsilon$-approximate NE whose social-welfare value is $\varepsilon$-close to optimal, or provides a sound certificate that no exact NE exists. Under a minimum reachability condition $p_{\mathrm{reach}}>0$ over relevant state-action pairs, the algorithm terminates after a polynomial number of trajectory samples, with sample complexity $\widetilde{O}\left( {R_{\max}^2 H^4 |S|^2 |A| / (p_{\mathrm{reach}} \varepsilon^2)} \right)$. Empirical results on benchmark CSGs demonstrate near-optimal performance, correct handling of equilibrium (non-)existence, and sample complexity consistent with theory.

AI 解读论文

并发随机游戏的鲁棒 PAC 学习框架,解决纳什均衡存在性问题。

核心方法
通过数据驱动的 $L^1$ 置信区间构建,并结合稳健的 MDP 探索机制,实现近似纳什均衡的学习。引入纳什边缘刻画以合理分析均衡存在性。
适合谁读
研究者、工程师
要解决的问题
并发随机游戏中的过渡不确定性导致学习纳什均衡时存在挑战,尤其是在不确定环境中。
关键实验
在标准并发随机游戏上进行了实验,证明了方法的近最优性能,并验证了样本复杂度与理论相符。
主要贡献
提出首个适用于并发随机游戏的鲁棒 PAC 学习框架,能够处理纳什均衡的存在性和优化问题,且在复杂度上具有多项式样本需求。
意义与局限
该研究对于多智能体系统在不确定环境中的学习与决策具有重要意义,但其应用前提条件可能限制其在现实世界的广泛使用。
领域:cs.LG作者:Angel Y. He、David Parker
相关推荐

本站内容由 LLM 精选聚合,原文版权归 arXiv 所有 · 摘录仅供参考