Split the Labor: Separating Evidence Interpretation from Decision Aggregation· 分离劳动:从多个来源中得出结论的系统设计
Systems that ask a language model to reach a conclusion from many sources usually concatenate them into one prompt. This conflates two operations with different requirements. Interpreting a source rewards capacity and context. Combining interpretations rewards fixed arithmetic, comparability across instances, and the option to return nothing. Once separated, the design problem becomes the interface between them. We propose a four-field evidence tuple (hypothesis, reliability bucket, rationale, provenance) and show that fixing it determines both halves. The separation also reveals a failure mode in how such systems combine, which we call count-scale drift. Thresholding a sum of unnormalized weights is exactly posterior thresholding, but at an operating point that slides with the number of s
分离证据解释与决策聚合的系统设计
- 核心方法
- 提出四字段证据元组(假设、可靠性桶、理由、来源)来分离证据解释与决策聚合过程
- 适合谁读
- 研究者 / 工程师
- 要解决的问题
- 现有系统在处理多源信息时,将证据解释与决策聚合混淆,导致性能不佳
- 关键实验
- 未提供
- 主要贡献
- 揭示并解决了多源信息系统的计数尺度漂移问题
- 意义与局限
- 该设计可以提高系统的准确性和可靠性,对于多源信息处理具有重要意义,但具体应用还需进一步验证