ai.hackcv
论文精选 65arXiv

PASTABench: Proactive Assessment of Sequential Trajectories for Agent Safety· PASTABench:代理安全的前瞻性评估

As Large Language Models (LLMs) evolve into autonomous agents that alter real-world states, ensuring operational safety across multi-step workflows has become a critical challenge. While recent work has moved beyond single-turn evaluation toward multi-turn paradigms, key limitations persist: step-level methods treat actions in isolation, missing how risks accumulate, while trajectory-level evaluations operate post-hoc, offering no opportunity for timely intervention. To address these limitations, we formalize Decoupled Proactive Safety Monitoring along three dimensions: whether to intervene, when to intervene, and what the risk is. We introduce PASTABench, a benchmark of 1,139 multi-turn trajectories spanning 5 risk categories and 13 subcategories. We further propose the Optimal Interventi

AI 解读论文

提出PASTABench以前瞻性评估自主代理的安全性

核心方法
形式化了解耦的前瞻性安全监控,包括干预、时间与风险评估三个维度
适合谁读
研究者, 工程师
要解决的问题
解决多步骤工作中自主代理操作安全性的评估问题
关键实验
未提供
主要贡献
引入PASTABench,包含1,139个多步骤轨迹和5个风险类别13个子类
意义与局限
提高了多步骤自主代理安全性评估的准确性和及时性,但可能需要大量计算资源
领域:cs.AI作者:Jiapeng Sun、Yujin Zhou、Han Zhu
相关推荐
论文精选 65已解读

Simulated Control Evals· 模拟控制评估

Control evaluations measure whether safeguards can prevent an AI model from causing undesi…

领域:cs.AI作者:Jeffrey Olmo、David Zhang、Tyler Tracy
📎 arXiv🕒 10-23 01:26🔗 arxiv.org

本站内容由 LLM 精选聚合,原文版权归 arXiv 所有 · 摘录仅供参考