Multi-agent Scaling Across Disjunctive and Compensatory Tasks· 多代理模型在分离与补偿任务中的扩展性
Multi-agent LLM systems are often expected to improve as team size increases, yet the scaling behavior may depend on task structure. Our central contribution is to introduce Steiner's taxonomy of group tasks as a framework for analyzing multi-agent LLM scaling and focusing the analysis on disjunctive and compensatory tasks. We model independently sampled agents as conditionally independent given the item, which yields their large-team limits: plurality voting converges to the model's modal answer, and averaging converges to the model's item-level bias. Across selected representative benchmarks, 13 open-weight models, and teams of up to 30 agents, we find qualitatively different scaling behavior. On disjunctive tasks, the probability that at least one agent is correct grows by 5-20 points w
多代理模型在不同任务结构中的扩展性分析
- 核心方法
- 基于Steiner的任务分类框架,将代理视为条件独立的模型,分析在分离和补偿任务中的多代理扩展性,通过多数表决和平均策略研究团队增大的效果
- 适合谁读
- 研究者、工程师
- 要解决的问题
- 探讨多代理大语言模型系统在不同任务类型下的性能扩展行为
- 关键实验
- 在13个开放权重模型和最多30个代理组成的团队中,通过选定的代表性基准测试进行实验
- 主要贡献
- 引入Steiner任务分类框架用于分析多代理模型,发现分离任务中至少一个代理正确率随团队规模增加而显著提升,补偿任务中则效果有限
- 意义与局限
- 为多代理系统的设计和应用提供了理论基础,强调了任务类型对扩展性的影响,但未深入探讨具体实现细节