BLADE: Auditing Information Use for Failure Attribution in LLM Multi-Agent Systems· BLADE:LLM多代理系统中的失败归因审计
Large language model multi-agent systems extend individual agents' capabilities through collaboration across specialized roles, tools, and workflows. Yet collaboration makes failures harder to diagnose: one agent may misinterpret a correct result while others carry the mistake forward. Failure attribution therefore seeks to identify the responsible agent and decisive error step. Recent methods trace dependencies, but knowing where information came from is not the same as knowing where it went wrong. We introduce BLADE (Blame Localization via Audited Dependency Evidence), a training-free framework that moves beyond tracing information to auditing its use. Using Jev for structured probabilistic judgments, BLADE uses dependency probabilities to select relevant source-decision handoffs for aud
LLM多代理系统中识别失败原因的新框架
- 核心方法
- BLADE通过审计信息的使用来定位责任代理和关键错误步骤,而不只是追踪信息的来源
- 适合谁读
- 研究者、工程师
- 要解决的问题
- LLM多代理系统的失败难以归因和诊断
- 关键实验
- 未提供
- 主要贡献
- 提出了一种无需训练的框架,能够更准确地识别失败的根源
- 意义与局限
- 改善了多代理系统中的错误诊断能力,提高了系统的可靠性和透明度,但仍需验证其在实际系统中的效果