Beyond the Sequentiality Bottleneck: A Hybrid Diffusion-Autoregressive Framework for Efficient Multimodal Reasoning· 突破顺序瓶颈:高效的多模态推理混合框架
Autoregressive models (ARMs) face a "Sequentiality Bottleneck" in reasoning, while diffusion language models (DLMs) offer parallelism but lack semantic coherence. To addresses both limitations, we propose Collaborative Reasoning Asymmetric Learning (CoRAL), a hybrid framework via an Asymmetric Planner-Executor (APE) architecture: a DLM Planner generates K diverse reasoning trajectories in parallel, while a large ARM Executor selects the optimal plan and synthesizes the final answer. To train the Planner effectively, we introduce Reward-Guided Denoising for CoT (RDC), which integrates outcome-based rewards into the diffusion process to steer it toward goal-directed reasoning. Experiments on vision-language benchmarks show that CoRAL significantly outperforms prior diffusion-based methods an
结合扩散模型和自回归模型优势,提升多模态推理效率和质量
- 核心方法
- 提出CoRAL框架,采用不对称规划执行架构,DLM并行生成多样性推理路径,大型ARM选择最优路径并合成最终答案;引入RDC训练规划器
- 适合谁读
- 研究者、工程师
- 要解决的问题
- 自回归模型存在顺序处理瓶颈,而扩散模型虽然并行但语义连贯性差
- 关键实验
- 在视觉-语言基准测试中显著优于先前基于扩散的方法
- 主要贡献
- 解决了扩散模型缺乏目标导向推理和自回归模型处理效率低的问题
- 意义与局限
- 为多模态推理任务提供了一种高效且语义连贯的新方法,但可能需要更多计算资源