ai.hackcv
论文精选 60arXiv

From Reactive Containment to Proactive Assurance: Lessons from OpenAI, Anthropic, and Google Agent Security Incidents· 从被动防护到主动保障:AI代理安全事件的教训

In 2026, cybersecurity evaluations involving OpenAI, Anthropic, and Google agents reached real systems outside their authorized test scope. The paths were different. OpenAI agents exploited research infrastructure, coordinated across runs, and compromised parts of Hugging Face's production environment. Anthropic reported cases in which a misconfigured third-party environment exposed real systems to agents pursuing simulated cyber tasks. In a separately reported evaluation, Google's Gemini accessed three real organizations through an unintended internet route; Google stated that the model stopped in all three instances. Taken together, the cases show why an evaluation cannot rely on an assumed boundary. That boundary must be verified while the agent is operating. This comparative instrumental case study develops a Proactive Agent Security Assurance Cycle (PASAC) and a five-layer Boundary Assurance Stack. The framework combines risk-tiered task design, executable scope contracts, pre-run validation, least-capability access, independent egress enforcement, credential restrictions, cross-run monitoring, automatic stop conditions, and evidence-based reauthorization. A leading-indicator model, nine design propositions, and seven falsifiable hypotheses turn these lessons into a testable research program. Because the public Gemini record is limited to attributed statements and journalism, its detailed causal mechanism remains provisional. The central conclusion is straightforward: proactive agent security requires continuous assurance across the full execution system, not confidence in any single sandbox or safeguard.

AI 解读论文

研究提出主动保障AI代理安全的新框架。

核心方法
开发Proactive Agent Security Assurance Cycle (PASAC)和五层Boundary Assurance Stack框架,整合风险分级任务设计、可执行范围合同、运行前验证、最小权限访问、独立出口强制、凭据限制、跨运行监控、自动停止条件和基于证据的再授权。
适合谁读
研究者、工程师、产品经理
要解决的问题
现有AI代理安全评估方法依赖假设边界,导致实际系统暴露风险。
关键实验
未提供
主要贡献
提出了一种全新的主动保障AI代理安全的方法,提供了一个可测试的研究计划。
意义与局限
该研究强调了AI代理安全需要在执行过程中进行连续保障,而非单纯依赖沙箱或单一防护措施,具有重要的实践指导意义。然而,Google的Gemini案例细节有限,具体机制仍需进一步验证。
领域:cs.CR作者:Abbas Raftari
相关推荐

本站内容由 LLM 精选聚合,原文版权归 arXiv 所有 · 摘录仅供参考