PASTABench: Proactive Assessment of Sequential Trajectories for Agent Safety· PASTABench:代理安全的前瞻性评估
As Large Language Models (LLMs) evolve into autonomous agents that alter real-world states, ensuring operational safety across multi-step workflows has become a critical challenge. While recent work has moved beyond single-turn evaluation toward multi-turn paradigms, key limitations persist: step-level methods treat actions in isolation, missing how risks accumulate, while trajectory-level evaluations operate post-hoc, offering no opportunity for timely intervention. To address these limitations, we formalize Decoupled Proactive Safety Monitoring along three dimensions: whether to intervene, when to intervene, and what the risk is. We introduce PASTABench, a benchmark of 1,139 multi-turn trajectories spanning 5 risk categories and 13 subcategories. We further propose the Optimal Interventi
提出PASTABench以前瞻性评估自主代理的安全性
- 核心方法
- 形式化了解耦的前瞻性安全监控,包括干预、时间与风险评估三个维度
- 适合谁读
- 研究者, 工程师
- 要解决的问题
- 解决多步骤工作中自主代理操作安全性的评估问题
- 关键实验
- 未提供
- 主要贡献
- 引入PASTABench,包含1,139个多步骤轨迹和5个风险类别13个子类
- 意义与局限
- 提高了多步骤自主代理安全性评估的准确性和及时性,但可能需要大量计算资源