ai.hackcv
论文精选 65arXiv

CHARM: A Multimodal Graph Foundation Model with Hierarchical Context Modeling for Zero-Shot Transfer· CHARM: 用于零样本迁移的多模态图基础模型

Graph foundation models (GFMs) have emerged as a promising paradigm for transferring knowledge across graph domains and tasks. Real-world graphs associate nodes with text, images, and other modalities, making multimodal graphs essential for representing complex entities and relations. Moreover, collecting labels and adapting models for every new graph domain is costly and often infeasible, motivating zero-shot transfer. Unfortunately, zero-shot transfer on multimodal graphs remains underexplored. Existing GNN-based graph foundation models typically require downstream adaptation, whereas LLM-based graph methods mainly address unimodal graphs or tasks within a single domain. This setting presents two key challenges. First, models must generalize knowledge from individual modalities while cap

AI 解读论文

零样本多模态图迁移模型CHARM介绍。

核心方法
提出CHARM模型,通过分层上下文建模,整合多模态信息,增强零样本迁移能力。
适合谁读
研究者 / 工程师
要解决的问题
现有多模态图神经网络模型在新图域上的零样本迁移能力不足。
关键实验
在多个零样本迁移任务上验证模型性能,具体实验数据和对比结果见论文。
主要贡献
实现多模态图的零样本迁移,减少新领域适应成本。
意义与局限
为多模态图处理提供新思路,但在不同场景下的泛化能力仍需进一步验证。
领域:cs.AI作者:Ankang Yang、Jitao Zhao、Di Jin
相关推荐

本站内容由 LLM 精选聚合,原文版权归 arXiv 所有 · 摘录仅供参考