论文精选 82arXiv

GoiBERT: Compact Vietnamese Language Models via Two-Stage Knowledge Distillation· GoiBERT：通过两阶段知识蒸馏实现的紧凑越南语模型

Vietnamese pre-trained encoders have improved rapidly, but the strongest ones are large, multilingual-vocabulary models or depend on external word segmentation, which makes them costly to deploy. We present GoiBERT, a family of two compact Vietnamese encoders with 26M and 49M parameters that operate directly on raw text. GoiBERT learns from two complementary teachers. A same-tokenizer Vietnamese encoder first teaches general-purpose representations. A much larger teacher then provides task-level guidance through soft labels that are generated without ever labeling its own training data. Across eight benchmarks covering text classification, aspect-based sentiment analysis, natural language inference, and named entity recognition, GoiBERT-large achieves the highest average score among non-te

领域：cs.CL作者：Quang Anh Kiet Tran、Nam Anh Tran、Manh Hung Trinh

#cs.CL

📎 发布于 10-22 01:24🔗 阅读原文（arxiv.org）📄 PDF

Low-Bit N-Gram Embeddings for Language Models· 大模型低精度 n-gram 嵌入

Many recent open-weight language models use n-gram embedding tables to improve performance…

领域：cs.CL作者：Stephen Chung、Wenyu Du

📎 arXiv🕒 10-23 01:56🔗 arxiv.org

论文精选 82

Can an Agent Debug a Web Corpus? Agentic Auditing of Slovak FineWeb2· LLM 能否调试网络语料库？

Multilingual pipelines such as FineWeb2 apply one recipe across a thousand languages, leav…

领域：cs.CL作者：Marek Šuppa、Ivan Vykopal、Jaroslav Kopčan

📎 arXiv🕒 10-23 01:52🔗 arxiv.org

论文精选 83

Bilingual Language Models Capture Cross-Linguistic Influence in Second-Language Reading· 双语模型捕捉二语阅读的跨语言影响

While monolingual language model (LM) surprisal is widely established as a predictor of re…

领域：cs.CL作者：Abderrahmane Issam、Irene E. Winther、Stefan L. Frank

📎 arXiv🕒 10-23 01:42🔗 arxiv.org

论文精选 82

How Ground Truth Shapes Retrieval Scores: Evidence-Aware Evaluation of a Retrieval-Augmented Generation System for Breast Lesions· 乳腺病变管理文献中的检索系统评估

Purpose: To describe an evidence-aware retrieval evaluation protocol for a clinical retrie…

领域：cs.CL作者：Miguel Mochizuki Silva、Samuel Ismael、Mateus C. Dias

📎 arXiv🕒 10-23 01:36🔗 arxiv.org

论文精选 80

Would an LLM Match into a Residency? Uncertainty, Reasoning and Image Use of Open Language Models on the Spanish MIR Examination· 大语言模型能通过医学考试吗？

Accuracy on medical examinations is common evidence offered for the clinical use of langua…

领域：cs.CL作者：Miguel Fernandez-de-Retana、Unai Zulaika、Ruben Sanchez-Corcuera

📎 arXiv🕒 10-23 01:23🔗 arxiv.org

本站内容由 LLM 精选聚合，原文版权归 arXiv 所有 · 摘录仅供参考