Epistemic Warrant for LLM Recommendations: Characterizing the Basis for Reliance When Ground Truth Is Unavailable· 大模型推荐的理论依据
Large language models are increasingly used to support organizational decisions, yet users often lack a principled basis for assessing whether to rely on a specific recommendation. Existing approaches typically evaluate broad model properties, such as reliability, uncertainty, or robustness, or focus on user trust, rather than the underlying basis for relying on an individual recommendation. Adapting theoretical foundations from epistemology, we introduce epistemic warrant, a decision-level construct that characterizes the stability of a model's preference and the scope over which that preference holds. We operationalize this construct through a four-tier reliance certificate for pairwise recommendations, distinguishing among unstable, context-dependent, locally supported, and broadly supp
大模型推荐如何在缺乏地面真实数据时评估可靠性。
- 核心方法
- 结合认知哲学的理论基础,引入认识论保证(epistemic warrant)作为一种决策级别的构念,通过四级依赖证书评估推荐的稳定性和适用范围。
- 适合谁读
- 研究者 / 工程师
- 要解决的问题
- 用户在使用大模型进行决策支持时,缺乏评估具体推荐的理论依据,尤其是在地面真实数据不可用的情况下。
- 关键实验
- 未提供
- 主要贡献
- 提出了一种基于认识论的框架,帮助用户评估大模型在特定情况下的推荐可靠性。
- 意义与局限
- 为大模型推荐的可靠性评估提供了新的理论和实践工具,但需要进一步的实验验证。