论文精选 82arXiv

KaliBench: A Fine-Grained Benchmark for Cybersecurity Tool Use on Kali Linux with Runtime-Free Verifiable Rewards· KaliBench：Kali Linux 网络安全工具使用微基准测试

LLMs are increasingly applied to cybersecurity workflows, where they are expected to translate analysts' intent into tool invocations. However, existing evaluations focus on knowledge-based assessments or end-to-end agentic tasks, and do not directly measure LLMs' ability to generate executable commands for real-world cybersecurity tools. This gap is critical because cybersecurity operations rely on strict command-line interfaces (CLIs), where minor syntax errors, incorrect flag--value bindings, or argument misordering can invalidate execution. We introduce KaliBench, a fine-grained benchmark and dataset for natural-language--to--CLI translation on Kali Linux, comprising 8,504 query--command pairs spanning 1,642 tools across 23 capability dimensions and 5 security phases. KaliBench is cons

领域：cs.CL作者：Pengfei Li、Naufal Suryanto、Sicheng Zhang

#cs.CL

📎 发布于 10-02 01:59🔗 阅读原文（arxiv.org）📄 PDF

Low-Bit N-Gram Embeddings for Language Models· 大模型低精度 n-gram 嵌入

Many recent open-weight language models use n-gram embedding tables to improve performance…

领域：cs.CL作者：Stephen Chung、Wenyu Du

📎 arXiv🕒 10-23 01:56🔗 arxiv.org

论文精选 82

Can an Agent Debug a Web Corpus? Agentic Auditing of Slovak FineWeb2· LLM 能否调试网络语料库？

Multilingual pipelines such as FineWeb2 apply one recipe across a thousand languages, leav…

领域：cs.CL作者：Marek Šuppa、Ivan Vykopal、Jaroslav Kopčan

📎 arXiv🕒 10-23 01:52🔗 arxiv.org

论文精选 83

Bilingual Language Models Capture Cross-Linguistic Influence in Second-Language Reading· 双语模型捕捉二语阅读的跨语言影响

While monolingual language model (LM) surprisal is widely established as a predictor of re…

领域：cs.CL作者：Abderrahmane Issam、Irene E. Winther、Stefan L. Frank

📎 arXiv🕒 10-23 01:42🔗 arxiv.org

论文精选 82

How Ground Truth Shapes Retrieval Scores: Evidence-Aware Evaluation of a Retrieval-Augmented Generation System for Breast Lesions· 乳腺病变管理文献中的检索系统评估

Purpose: To describe an evidence-aware retrieval evaluation protocol for a clinical retrie…

领域：cs.CL作者：Miguel Mochizuki Silva、Samuel Ismael、Mateus C. Dias

📎 arXiv🕒 10-23 01:36🔗 arxiv.org

论文精选 80

Would an LLM Match into a Residency? Uncertainty, Reasoning and Image Use of Open Language Models on the Spanish MIR Examination· 大语言模型能通过医学考试吗？

Accuracy on medical examinations is common evidence offered for the clinical use of langua…

领域：cs.CL作者：Miguel Fernandez-de-Retana、Unai Zulaika、Ruben Sanchez-Corcuera

📎 arXiv🕒 10-23 01:23🔗 arxiv.org

本站内容由 LLM 精选聚合，原文版权归 arXiv 所有 · 摘录仅供参考