Beyond Retrieval: Analytic Memory for Multimodal Agents· 超越检索:多模态代理的分析记忆
Long-term multimodal memory must support not only retrieving relevant information but also computing over observations accumulated across interactions. Existing systems largely emphasize \emph{retrieval memory}, organizing interaction histories through summaries and indexes to return query-relevant information at multiple granularities, from high-level abstractions to underlying records. In this paper, we formulate \emph{analytic memory} as a complementary abstraction that organizes recurring multimodal observations into queryable structures supporting filtering, aggregation, ranking, and temporal comparison. We present AdaMM, a framework that jointly supports retrieval and analytic memory. Rather than relying on application-defined schemas, AdaMM extracts provenance-linked attribute-value
提出多模态代理的新记忆框架,支持检索与分析。
- 核心方法
- AdaMM框架将多模态观察组织成可查询结构,支持过滤、聚合、排序及时序比较,不再依赖应用定义的模式,而是自动提取属性-值对。
- 适合谁读
- 研究者
- 要解决的问题
- 现有系统多侧重于检索记忆,而对长期多模态记忆中积累的观察进行计算的能力不足。
- 关键实验
- 未提供具体实验数据,主要讨论框架的设计和可能性。
- 主要贡献
- 引入分析记忆的概念,并提出AdaMM框架,拓展了多模态代理的记忆能力。
- 意义与局限
- 提供了一种新的思考方式来处理多模态数据,增强代理的理解和决策能力;但具体应用场景和技术实现尚需进一步探索。