Causal Memory Policy: Making Memory Utility Identifiable by Intervening on Retrieval· 因果记忆策略
Memory-augmented large language models must decide which memories to retain, and recent systems do so by estimating each memory's effect on task performance. However, these estimates rely entirely on retrieved memories. When a memory is never retrieved, store-level interventions produce identical outcomes, leaving its utility unidentified. This is a retrieval-level positivity violation, invisible to diagnostics that examine only memory operations. We introduce Causal Memory Policy (CMP), a causal framework that restores identification by intervening on retrieval itself, reserving a fixed number of context slots for memories sampled with known propensities. CMP estimates memory utility by self-normalized inverse propensity weighting under a balanced assignment design. We prove the causal fa
通过干预检索来识别记忆效用,提升记忆增强大模型的决策能力。
- 核心方法
- 引入因果记忆策略(CMP),通过干预检索过程,为具有已知倾向性的记忆样本预留固定数量的上下文槽,使用自归一化的逆倾向加权方法在平衡分配设计下估计记忆效用。
- 适合谁读
- 研究者
- 要解决的问题
- 现有的记忆增强大语言模型在决定保留哪些记忆时,仅依赖被检索的记忆,导致未被检索的记忆的效用无法被准确识别。
- 关键实验
- 未提供
- 主要贡献
- 提出了一个因果框架,解决了检索级别的积极性违反问题,使未被检索的记忆效用也能被识别。
- 意义与局限
- 提高了记忆增强大语言模型在保留和利用记忆时的决策准确性,但需要进一步实验验证其效果。