Reasoning with Continuous Latent Diffusion· 连续潜在扩散的推理
Continuous diffusion generates complete reasoning solutions through iterative refinement in latent space. We introduce Latent Flow Reasoning Models (LFRMs), an ELF-based training and inference recipe. Our experiments show that accurate decoding alone does not ensure strong reasoning performance. We therefore learn compact representations from multiple layers of a strong autoregressive teacher. Their decomposition also enables asynchronous denoising at different rates. We show that prompt encodings need only preserve the information required for the correct text-conditional score, rather than exactly match teacher features, and use a staged curriculum to learn a compact prompt encoder that replaces the teacher Transformer at inference. We adapt DiffusionNFT to learned self-conditioning guid
介绍使用连续潜在扩散模型进行推理的方法。
- 核心方法
- 提出潜流推理模型(LFRMs),基于ELF的训练和推理方法,从强自回归教师的多层学习紧凑表示,实现异步去噪,并使用分阶段课程学习来训练紧凑的提示编码器。
- 适合谁读
- 研究者
- 要解决的问题
- 如何在潜空间中通过迭代精炼生成完整的推理解决方案,提高模型的推理能力。
- 关键实验
- 实验展示了准确解码不保证强推理性能,提出的方法能有效提升推理能力,且提示编码器只需保留文本条件分数所需信息。
- 主要贡献
- 提出了一种新的推理模型LFRMs,通过多层特征学习和异步去噪提升推理性能,同时减少了对教师模型的依赖。
- 意义与局限
- 该方法为提高模型推理能力提供了新的思路,但目前仅在特定任务上进行了验证,可能需要进一步探索其泛化性能。