Low-Bit N-Gram Embeddings for Language Models· 大模型低精度 n-gram 嵌入
Many recent open-weight language models use n-gram embedding tables to improve performance…
Many recent open-weight language models use n-gram embedding tables to improve performance…
Multilingual pipelines such as FineWeb2 apply one recipe across a thousand languages, leav…
While monolingual language model (LM) surprisal is widely established as a predictor of re…
Purpose: To describe an evidence-aware retrieval evaluation protocol for a clinical retrie…
Accuracy on medical examinations is common evidence offered for the clinical use of langua…
Reinforcement learning (RL) is an effective way to strengthen the long-context reasoning o…
Through a tangle of real-world interactions, from synthetic training pipelines to data sha…
Quantitative research is an iterative loop: a researcher proposes a market hypothesis, imp…
Many NP-complete (NPC) problems have a polynomial-time (P) twin that differs in a single s…
Vietnamese pre-trained encoders have improved rapidly, but the strongest ones are large, m…
Picture-description dementia classification uses a shared visual scene, but a transcript-l…
Mathematical reasoning remains underexplored for low-resource languages, including Dialect…
Agentic on-policy distillation (OPD) trains a student agent on its own trajectories while …
Large Language Model (LLM) agents can handle increasingly complex tasks, navigating long t…
Continuous flow language models offer a path to parallel generation with tools for control…
Multimodal large language models (MLLMs) have made rapid progress on visual reasoning, yet…
Systems that combine several large language models (LLMs) often use one context for many q…
Many modern language models have adopted hybrid architectures that incorporate both linear…
Context compression improves long-context efficiency but may introduce faithfulness issues…
Beyond basic tool use and coding skills, effectively incorporating visual references into …
Fine-tuning large language models (LLMs) can induce behaviors beyond those explicitly targ…
Scientific discovery requires developing worthwhile hypotheses into practical investigatio…
A reasoning trace can accompany a correct answer without providing effective supervision f…
Speculative decoding typically characterizes speedup by draft tokens accepted per verifica…
While deriving text embeddings directly from frozen LLMs has emerged as a promising direct…
Generative visual verifiers play a crucial role in advancing multimodal intelligence. To e…
One of the first steps of a research pipeline is generating ideas. Large Language Models (…
With people increasingly turning to AI chatbots for mental health support, the need to eva…
Spatial instructions describe how to move objects, transform regions, or modify their surr…
Not all facts a language model can recall support further learning equally well. We distin…
Long contexts enlarge key--value (KV) caches, increasing memory use and attention costs du…
Brazilian Portuguese remains underserved by open-source language models, and the few that …
Understanding the social intelligence of large language models (LLMs) is increasingly impo…
Multimodal code intelligence connects the symbolic world of programs with the visual world…
On-policy self-distillation provides dense supervision for reasoning models via a privileg…
Long-horizon agents have drawn growing attention for their ability to work autonomously --…
Reasoning models achieve strong performance through long chains of thought (CoT), but ofte…
How can we build an agent that thinks beyond human language, yet still acts through it in …
Pre-trained Large Language Model (LLMs) are effective on many tasks in zero-shot and few-s…
LLM ensemble gains are often measured against a single baseline, but the value attributed …
Recursive self-improvement (RSI) aims to transform interaction experience into persistent …
Vision-Language Models (VLMs) increasingly analyze and reason about images, yet it remains…
Neural semantic parsers generate meaning representations token by token, yet well-formedne…
Large language models reuse the same attention heads across tasks, but identifying these s…
A useful language model should know when to answer and when to say "I don't know." Can we …
LLM developers post-train their models to exhibit prosocial values and behavioral traits, …
Tokenizers are commonly optimized for compression, but a compact vocabulary does not neces…
Skills, reusable procedural guidance added at inference, can substantially improve LLM dow…
While caching key-value (KV) states accelerates Large Language Model (LLM) decoding, this …
Text-to-SQL models are commonly trained to map questions directly to static queries, where…
Conditional memory architectures such as DeepSeek Engram use input n-grams to look up lear…
Prompted embedding models have recently received increasing attention, particularly for re…
Hallucinated information can propagate through multi-stage LLM systems and become part of …
Terminal-agent capability depends jointly on model weights and the runtime harness that fo…
Document-level text simplification involves transformations that go beyond sentence-intern…
Scientific research often begins by synthesizing ideas from a set of related papers to ide…
Web agents complete user requests by reading and acting on pages that third parties write,…
A common approach to measuring bias in Large Language Models is to compare the log-likelih…
Diffusion Language Models (DLMs) hold the promise of order-agnostic, parallel text generat…
Reusing the scores that select a Best-of-$N$ winner can overstate its expected reward. We …