ai.hackcv
论文精选 61arXiv

Beyond the Single Camera: Agentic Multi-View Reasoning in Sports Video Understanding· 超越单视角:体育视频中的代理多视角推理

Recent Multimodal Large Language Models (MLLMs) achieve strong performance on single-view video understanding benchmarks. However, sports videos involve dense occlusion, rapid motion, and complex interactions that are difficult to resolve from a single viewpoint. In practice, sports events are recorded from multiple camera angles, providing complementary evidence used by referees. Yet, no existing benchmark evaluates MLLMs on multi-view sports video understanding. To address this gap, we introduce SportMV-Bench, a comprehensive benchmark built from official match recordings, through a dedicated pipeline combining LLM-based generation, MLLM-based verification, and human filtering to ensure quality and consistency. SportMV-Bench containing 787 multi-view video bundles and 2592 question-answer pairs across three categories: Perception-Aware Recognition (PAR), Rule-aware Event Interpretation (REI), and Adjudicative Decision Reasoning(ADR). Our analysis shows that current MLLMs fail to effectively exploit multi-view information, with the bottlenecks lying in fine-grained visual perception and view selection rather than logical reasoning or domain knowledge. We propose SportMV-Agent, an agentic framework that orchestrates an iterative loop of active view selection, perception tool execution, and evidence-grounded reasoning, achieving a significant 14.46% relative improvement over the strongest MLLM baseline.

AI 解读论文

提出多视角代理框架和基准,以提升体育视频理解能力。

核心方法
构建了 SportMV-Bench 基准,包含多视角视频和 QA 对,提出 SportMV-Agent 框架,实现多视角信息的有效利用。
适合谁读
研究者、工程师、产品团队
要解决的问题
现有模型在单视角体育视频理解上表现良好,但难以处理多视角视频中的遮挡、快速运动和复杂交互。
关键实验
SportMV-Bench 包含 787 多视角视频包和 2592 个 QA 对,实验显示 SportMV-Agent 框架比最强 MLLM 基线提高了 14.46%。
主要贡献
首个专门评估多视角体育视频理解的基准,以及代理框架,显著提升理解效果。
意义与局限
推动体育视频理解领域的技术进步,但可能受限于细粒度视觉感知和视角选择。
领域:cs.CV作者:Kerui Chen、Jinglu Wang、Xiaoyi Zhang
相关推荐
论文精选 60已解读

Principia: Relational Physics Tests for Video Models· Principia:视频模型的物理测试

Evaluating physical reasoning in video models is difficult because absolute motion measure…

领域:cs.CV作者:Varun Varma Thozhiyoor、Shivam Tripathi、Venkatesh Babu Radhakrishnan
📎 arXiv🕒 09-04 01:59🔗 arxiv.org

本站内容由 LLM 精选聚合,原文版权归 arXiv 所有 · 摘录仅供参考