ai.hackcv
论文精选 60arXiv

Beyond Retrieval: Analytic Memory for Multimodal Agents· 超越检索:多模态代理的分析记忆

Long-term multimodal memory must support not only retrieving relevant information but also computing over observations accumulated across interactions. Existing systems largely emphasize \emph{retrieval memory}, organizing interaction histories through summaries and indexes to return query-relevant information at multiple granularities, from high-level abstractions to underlying records. In this paper, we formulate \emph{analytic memory} as a complementary abstraction that organizes recurring multimodal observations into queryable structures supporting filtering, aggregation, ranking, and temporal comparison. We present AdaMM, a framework that jointly supports retrieval and analytic memory. Rather than relying on application-defined schemas, AdaMM extracts provenance-linked attribute-value

AI 解读论文

提出多模态代理的新记忆框架,支持检索与分析。

核心方法
AdaMM框架将多模态观察组织成可查询结构,支持过滤、聚合、排序及时序比较,不再依赖应用定义的模式,而是自动提取属性-值对。
适合谁读
研究者
要解决的问题
现有系统多侧重于检索记忆,而对长期多模态记忆中积累的观察进行计算的能力不足。
关键实验
未提供具体实验数据,主要讨论框架的设计和可能性。
主要贡献
引入分析记忆的概念,并提出AdaMM框架,拓展了多模态代理的记忆能力。
意义与局限
提供了一种新的思考方式来处理多模态数据,增强代理的理解和决策能力;但具体应用场景和技术实现尚需进一步探索。
领域:cs.AI作者:Zhoujin Tian、Yao Tian、Hao Zhang
相关推荐

本站内容由 LLM 精选聚合,原文版权归 arXiv 所有 · 摘录仅供参考