ai.hackcv
论文精选 60arXiv

Multi-agent Scaling Across Disjunctive and Compensatory Tasks· 多代理模型在分离与补偿任务中的扩展性

Multi-agent LLM systems are often expected to improve as team size increases, yet the scaling behavior may depend on task structure. Our central contribution is to introduce Steiner's taxonomy of group tasks as a framework for analyzing multi-agent LLM scaling and focusing the analysis on disjunctive and compensatory tasks. We model independently sampled agents as conditionally independent given the item, which yields their large-team limits: plurality voting converges to the model's modal answer, and averaging converges to the model's item-level bias. Across selected representative benchmarks, 13 open-weight models, and teams of up to 30 agents, we find qualitatively different scaling behavior. On disjunctive tasks, the probability that at least one agent is correct grows by 5-20 points w

AI 解读论文

多代理模型在不同任务结构中的扩展性分析

核心方法
基于Steiner的任务分类框架,将代理视为条件独立的模型,分析在分离和补偿任务中的多代理扩展性,通过多数表决和平均策略研究团队增大的效果
适合谁读
研究者、工程师
要解决的问题
探讨多代理大语言模型系统在不同任务类型下的性能扩展行为
关键实验
在13个开放权重模型和最多30个代理组成的团队中,通过选定的代表性基准测试进行实验
主要贡献
引入Steiner任务分类框架用于分析多代理模型,发现分离任务中至少一个代理正确率随团队规模增加而显著提升,补偿任务中则效果有限
意义与局限
为多代理系统的设计和应用提供了理论基础,强调了任务类型对扩展性的影响,但未深入探讨具体实现细节
领域:cs.AI作者:Carolina Fortuna、Blaz Bertalanic
相关推荐
论文精选 65已解读

Simulated Control Evals· 模拟控制评估

Control evaluations measure whether safeguards can prevent an AI model from causing undesi…

领域:cs.AI作者:Jeffrey Olmo、David Zhang、Tyler Tracy
📎 arXiv🕒 10-23 01:26🔗 arxiv.org

本站内容由 LLM 精选聚合,原文版权归 arXiv 所有 · 摘录仅供参考