The Seriality Gap in Video Diffusion Models· 视频扩散模型的串行性差距
When one ball strikes another, then another, video models should predict the consequences of each bounce. In controlled experiments on multi-ball hard-sphere dynamics, we find that the performance of standard bidirectional video diffusion degrades as the causal chain lengthens, even when provided more denoising steps. In a length-matched single-ball control, where ball-ball interactions are absent, the degradation largely disappears, isolating dependent-event structure rather than video length as the cause. Across intervention studies, methods that increase effective serial computation improve performance disproportionately, including autoregressive/blockwise generation and architectural depth. We identify this pattern as the seriality gap: a mismatch between tasks requiring growing serial computation and video diffusion models whose denoising loop does not provide scalable serial compute. We then prove that, for deterministic video prediction, denoising steps do not add serial computation beyond the backbone, indicating a structural obstacle for video diffusion on serial reasoning and simulation tasks.
视频扩散模型在因果链长时预测表现下降,串行计算结构需改进。
- 核心方法
- 通过控制实验研究多球硬球动力学,分析不同方法在增加有效串行计算时的性能提升,包括自回归/块生成和架构深度优化。
- 适合谁读
- 研究者、工程师
- 要解决的问题
- 这篇论文探讨了视频扩散模型在处理长因果链时的性能下降问题,尤其是在多球碰撞等依赖事件的预测任务中。
- 关键实验
- 关键实验包括多球碰撞动力学和单球控制实验,展示了去噪步骤数增加时的性能变化。
- 主要贡献
- 识别并定义了视频扩散模型中的串行性差距,并证明了去噪步骤在确定性视频预测任务中不能提供可扩展的串行计算。
- 意义与局限
- 该研究揭示了视频扩散模型在处理依赖事件时的局限性,为未来模型的改进提供了方向。但研究主要集中在多球碰撞等特定任务上,普适性有待进一步验证。