Beyond the Single Camera: Agentic Multi-View Reasoning in Sports Video Understanding· 超越单视角:体育视频中的代理多视角推理
Recent Multimodal Large Language Models (MLLMs) achieve strong performance on single-view video understanding benchmarks. However, sports videos involve dense occlusion, rapid motion, and complex interactions that are difficult to resolve from a single viewpoint. In practice, sports events are recorded from multiple camera angles, providing complementary evidence used by referees. Yet, no existing benchmark evaluates MLLMs on multi-view sports video understanding. To address this gap, we introduce SportMV-Bench, a comprehensive benchmark built from official match recordings, through a dedicated pipeline combining LLM-based generation, MLLM-based verification, and human filtering to ensure quality and consistency. SportMV-Bench containing 787 multi-view video bundles and 2592 question-answer pairs across three categories: Perception-Aware Recognition (PAR), Rule-aware Event Interpretation (REI), and Adjudicative Decision Reasoning(ADR). Our analysis shows that current MLLMs fail to effectively exploit multi-view information, with the bottlenecks lying in fine-grained visual perception and view selection rather than logical reasoning or domain knowledge. We propose SportMV-Agent, an agentic framework that orchestrates an iterative loop of active view selection, perception tool execution, and evidence-grounded reasoning, achieving a significant 14.46% relative improvement over the strongest MLLM baseline.
提出多视角代理框架和基准,以提升体育视频理解能力。
- 核心方法
- 构建了 SportMV-Bench 基准,包含多视角视频和 QA 对,提出 SportMV-Agent 框架,实现多视角信息的有效利用。
- 适合谁读
- 研究者、工程师、产品团队
- 要解决的问题
- 现有模型在单视角体育视频理解上表现良好,但难以处理多视角视频中的遮挡、快速运动和复杂交互。
- 关键实验
- SportMV-Bench 包含 787 多视角视频包和 2592 个 QA 对,实验显示 SportMV-Agent 框架比最强 MLLM 基线提高了 14.46%。
- 主要贡献
- 首个专门评估多视角体育视频理解的基准,以及代理框架,显著提升理解效果。
- 意义与局限
- 推动体育视频理解领域的技术进步,但可能受限于细粒度视觉感知和视角选择。