ai.hackcv
论文精选 83arXiv

Preserve to Expand: Source-Aware Adaptation and Model Merging for Multilingual LLM-Based ASR· 多语言大模型ASR的源感知适应与模型合并

Expanding multilingual ASR systems to new languages is challenging when adaptation must preserve previously supported languages without replaying source-language training data. We study this problem in connector-based Speech LLMs, where a trainable connector maps speech representations into a frozen large language model. We evaluate target-update construction and merging strategies for adapting the connector while preserving source-language performance. In single-target expansion, target-only fine-tuning and standard TIES merging learn new languages but cause severe source-language forgetting, while SSU-Wanda+TIES gives the best source-preserving trade-off. In multi-target expansion, update merging provides stable source retention, whereas recursive expansion can improve target adaptation

领域:cs.CL作者:Yuchen Zhang、Haralambos Mouratidis、Ravi Shekhar
相关推荐
论文精选 85

Quantifying Claim Smoothing by LLM Research Agents· 量化 LLM 研究代理的主张平滑

Deep research, or any use of large language models (LLMs) to read a large document collect…

领域:cs.CL作者:Tiasa Singha Roy、Manya Wadhwa、Greg Durrett
📎 arXiv🕒 10-27 01:29🔗 arxiv.org

本站内容由 LLM 精选聚合,原文版权归 arXiv 所有 · 摘录仅供参考