Report: Progressive Disclosure of Agent Skills
Users of Workday's deployed LLM-based agents often request features which can be addressed by defining named procedures, also known as skills, in the LLM context, effectively augmenting agents' capabilities. However, as an agent's skills library grows in size, so does the agent's operational cost. Progressive disclosure (lazy-loading) of skills as needed may reduce operational costs, but its impact on overall latency and skill-retrieval quality remains unclear. In this report, we investigate the impact empirically and find that progressive disclosure improves skill-retrieval quality but marginally degrades overall latency.
渐进披露技术在减少LLM代理成本的同时提高了技能检索质量,但略微增加了整体延迟。
- 核心方法
- 研究通过渐进披露(按需加载)技能来减少代理操作成本的方法,评估其对整体延迟和技能检索质量的影响。
- 适合谁读
- 研究者、工程师
- 要解决的问题
- 随着LLM代理技能库的增长,其操作成本增加,如何有效降低这些成本。
- 关键实验
- 通过实证研究展示了渐进披露技能的效果,具体实验数据未提供。
- 主要贡献
- 实证分析了渐进披露技能对LLM代理性能的影响,为优化代理操作提供了依据。
- 意义与局限
- 为提高LLM代理的效率和性能提供了新的视角,但在实际应用中可能需要平衡延迟增加的问题。