MUSE: Benchmarking Large Vision-Language Models on Multi-Modal Understanding in Situated Education· MUSE:基准测试大型视觉-语言模型在教育场景中的多模态理解
Large vision-language models have achieved remarkable progress in multi-modal understanding, yet their capabilities in educational settings remain insufficiently evaluated. In AI-assisted language learning, models must interpret artistic imagery, understand its semantic, affective, and cultural content, and reason about visual context to support meaningful interaction. However, existing benchmarks primarily focus on real-world images or domain-specific educational reasoning, providing limited coverage of artistic educational content. To address this gap, we introduce MUSE, a benchmark for evaluating large vision-language models on artistic image understanding in situated educational applications. MUSE decouples image annotation from question generation, enabling diverse tasks with controll
MUSE 基准测试评估大型视觉-语言模型在教育应用中的艺术图像理解能力。
- 核心方法
- MUSE 通过将图像标注与问题生成解耦,提供一个多样化的任务集合来评估模型的多模态理解能力。
- 适合谁读
- 研究者、教育技术开发者
- 要解决的问题
- 现有基准测试在教育场景中对艺术图像的理解和解释能力不足。
- 关键实验
- 未提供
- 主要贡献
- 提出了 MUSE 基准测试,填补了艺术教育内容评估的空白。
- 意义与局限
- 有助于提升 AI 辅助语言学习中的图像理解和交互质量,但目前实验数据有限。