Jev-DLC: Decision-Level Continual Learning from Typed Feedback· Jev-DLC: 基于类型反馈的决策级持续学习
Individual preferences often become visible only after deployment, when a user accepts one decision or revokes it in favor of another. Jev-style typed interfaces make this feedback explicit by identifying the selected action and, under revocation, the decision it replaces. We study how these consequences persist across requests as Decision-Level Continual Learning from Typed Feedback (Jev-DLC). Jev-DLC treats each correction as both evidence about a recurring action identity and a directed relation between the preferred and rejected choices. It preserves these signals in complementary bounded channels above a frozen scorer and combines their scores to shape the next decision. The method retains no raw interaction history, adds no scorer call, and performs no runtime language-model backward
从用户类型反馈中学习并持续优化决策模型。
- 核心方法
- 通过Jev-DLC方法，将每次用户的纠正视为对重复动作身份的证据和偏好的选择与拒绝之间的关系，并在冻结的评分手之上通过互补的有界通道保持这些信号，结合得分以塑造下一次决策。
- 适合谁读
- 研究者 / 工程师
- 要解决的问题
- 如何利用用户在使用过程中的偏好反馈来改进和持续更新决策级学习模型。
- 关键实验
- 未提供
- 主要贡献
- 提出了一种无需保留原始交互历史、不增加评分调用次数、不在运行时进行语言模型反向传播的决策级持续学习方法。
- 意义与局限
- 该研究有助于改善个性化决策系统，提升用户体验，尤其是在用户偏好随时间发生变化的情况下。然而，该方法可能对不同类型反馈的处理能力有限，适用性需要进一步验证。