ai.hackcv
论文精选 65arXiv

Knowing the User Is Not Knowing What We Established: Grounding Awareness in Personal Agents· 个人代理中的根基意识

Personal-agent memory has largely focused on learning what users know, prefer, and want. However, knowing the user does not necessarily mean knowing what the user and the agent have established together. An assistant's proposal should not become an authorized instruction merely because it is remembered. We introduce Grounding Awareness, the ability to distinguish accepted, unacknowledged, revised, and scoped arrangements when selecting actions. We develop a controlled benchmark to test whether agents can tell the difference between proposals users have accepted and those they have not, and whether they apply accepted arrangements only where appropriate. Across multiple agents and memory systems, we find that strong memory performance does not ensure Grounding Awareness. More surprisingly,

AI 解读论文

个人代理需要区分用户接受与未接受的安排,仅强记忆性能不足以确保此能力。

核心方法
引入了一种称为根基意识的新能力,开发了一个受控基准测试来评估代理是否能正确区分用户接受和未接受的提议,并确保在适当情况下应用已接受的安排。
适合谁读
研究者、工程师
要解决的问题
现有个人代理的记忆系统无法准确区分用户已接受、未确认、修改或有限制的安排。
关键实验
开发了一个受控基准测试,测试了多个代理和记忆系统在区分用户接受与未接受安排方面的能力。
主要贡献
首次定义了个人代理的根基意识概念,并提供了测试方法,揭示了当前代理在这一方面的能力不足。
意义与局限
该研究揭示了个人代理在与用户互动时需要具备更复杂的能力,对提高代理的真实世界适用性具有重要意义。但该基准测试仅涵盖了有限的场景,未来需要进一步扩展。
领域:cs.AI作者:Jiajun Chen、Xinyue Chen、Yicheng Jiang
相关推荐
论文精选 65已解读

Simulated Control Evals· 模拟控制评估

Control evaluations measure whether safeguards can prevent an AI model from causing undesi…

领域:cs.AI作者:Jeffrey Olmo、David Zhang、Tyler Tracy
📎 arXiv🕒 10-23 01:26🔗 arxiv.org

本站内容由 LLM 精选聚合,原文版权归 arXiv 所有 · 摘录仅供参考