ai.hackcv
论文精选 85arXiv

Testimony from Timelines: Evidence-Grounded Significance Testing of Temporal Clinical Hypotheses· 时间线证据在临床假设检验中的应用

Ask a language model whether sales tend to dip after a product recall, or whether one side effect tends to follow another after a vaccine, and it answers in a fluent sentence that reads like a finding, with no test behind it. Assertions about how events unfold across many cases fill the Web, and each is a temporal hypothesis that only a significance test over the right records can settle. The verifier must specify the null, select the test and decide which records bear on the hypothesis, and any of these choices can go wrong while the conclusion still comes out right. Yet benchmarks for language-model data analysis grade only the conclusion, with the relevant data handed over. We study the problem in health, where a wrong verdict is costly, and present STRATA, a benchmark that grades every

领域:cs.CL作者:Chengyang He、Wenlong Zhang、Koduvayur Subbalakshmi
相关推荐
论文精选 82

Elucidating the Design Space of LM Data Attribution· 阐明大模型数据归属的设计空间

Data attribution methods for Language Models (LMs) are typically evaluated using downstrea…

领域:cs.CL作者:Steven Yu、Sheng-Yu Wang、Kimia Hamidieh
📎 arXiv🕒 10-30 01:59🔗 arxiv.org

本站内容由 LLM 精选聚合,原文版权归 arXiv 所有 · 摘录仅供参考