论文精选 83arXiv

SCB: SpeechConversationBench for Evaluating Multi-Turn Reasoning in Speech-to-Speech Models· SCB：评估语音对话模型的多轮推理能力

Speech-to-speech systems must solve tasks whose requirements emerge across conversational turns. We introduce SpeechConversationBench (SCB), a focused evaluation of spoken mathematical reasoning using 103 sharded GSM8K problems. The framework compares the original problem delivered in one turn (full), its concatenated information shards delivered together (concat), and incremental spoken disclosure across turns (sharded). We report final-answer accuracy for four commercial speech systems and LEGO, a proprietary speech pipeline developed internally by the SCBX Innovation Lab team with explicit conversational context management. Relative to concat, sharded accuracy decreases by 5.0-25.3 percentage points across the four commercial systems. LEGO achieves 77.5 percent accuracy in all three con

领域：cs.CL作者：Kanpat Vesessook、Saksorn Ruangtanusak

#cs.CL

📎 发布于 10-01 01:13🔗 阅读原文（arxiv.org）📄 PDF

Low-Bit N-Gram Embeddings for Language Models· 大模型低精度 n-gram 嵌入

Many recent open-weight language models use n-gram embedding tables to improve performance…

领域：cs.CL作者：Stephen Chung、Wenyu Du

📎 arXiv🕒 10-23 01:56🔗 arxiv.org

论文精选 82

Can an Agent Debug a Web Corpus? Agentic Auditing of Slovak FineWeb2· LLM 能否调试网络语料库？

Multilingual pipelines such as FineWeb2 apply one recipe across a thousand languages, leav…

领域：cs.CL作者：Marek Šuppa、Ivan Vykopal、Jaroslav Kopčan

📎 arXiv🕒 10-23 01:52🔗 arxiv.org

论文精选 83

Bilingual Language Models Capture Cross-Linguistic Influence in Second-Language Reading· 双语模型捕捉二语阅读的跨语言影响

While monolingual language model (LM) surprisal is widely established as a predictor of re…

领域：cs.CL作者：Abderrahmane Issam、Irene E. Winther、Stefan L. Frank

📎 arXiv🕒 10-23 01:42🔗 arxiv.org

论文精选 82

How Ground Truth Shapes Retrieval Scores: Evidence-Aware Evaluation of a Retrieval-Augmented Generation System for Breast Lesions· 乳腺病变管理文献中的检索系统评估

Purpose: To describe an evidence-aware retrieval evaluation protocol for a clinical retrie…

领域：cs.CL作者：Miguel Mochizuki Silva、Samuel Ismael、Mateus C. Dias

📎 arXiv🕒 10-23 01:36🔗 arxiv.org

论文精选 80

Would an LLM Match into a Residency? Uncertainty, Reasoning and Image Use of Open Language Models on the Spanish MIR Examination· 大语言模型能通过医学考试吗？

Accuracy on medical examinations is common evidence offered for the clinical use of langua…

领域：cs.CL作者：Miguel Fernandez-de-Retana、Unai Zulaika、Ruben Sanchez-Corcuera

📎 arXiv🕒 10-23 01:23🔗 arxiv.org

本站内容由 LLM 精选聚合，原文版权归 arXiv 所有 · 摘录仅供参考