Beyond Surface Imitation: Contrastive Modeling for Reasoning Path Alignment in Multimodal In-Context Learning· 超越表面模仿:多模态上下文学习中的推理路径对齐对比模型
In-context learning (ICL) is widely used in multimodal large language models (MLLMs) and achieves strong performance across a wide range of multimodal tasks. However, existing multimodal ICL methods often rely on surface level imitation of in-context demonstrations, making it difficult for MLLMs to align their responses with the reasoning path required by the given multimodal input. This limitation becomes more pronounced in complex multimodal tasks, thereby restricting further improvements in MLLM performance. To address this issue, we propose a new multimodal ICL framework that combines contrastive demonstration modeling with the self-refinement capability of MLLMs. Specifically, our framework reformulates each demonstration by explicitly contrasting a suboptimal response with a better r
提出对比模型框架,改善多模态大模型推理路径对齐。
- 核心方法
- 结合对比示范建模与模型自修正能力的多模态上下文学习框架。
- 适合谁读
- 研究者
- 要解决的问题
- 现有方法在多模态任务中仅依赖表面模仿,导致模型难以与输入所需的推理路径对齐。
- 关键实验
- 未提供
- 主要贡献
- 提升多模态大语言模型在复杂任务中的推理路径对齐能力,推动性能进阶。
- 意义与局限
- 突破传统表面模仿限制,提高模型理解与生成质量,但需更多实验验证。