ai.hackcv
论文精选 85arXiv

AdvSim2Real : Training Web Agents Against Adaptive Prompt Injection in a Web World Model· AdvSim2Real:在 Web 世界模型中对抗适应性提示注入

Web agents complete user requests by reading and acting on pages that third parties write, so an instruction planted on a page can redirect the agent away from the user's goal. The agent cannot simply ignore the page, because the page also holds the values and controls the task requires. Current defenses fine-tune the agent on injections fixed before training, and attackers that adapt to the trained model bypass them. Adversarial training lets the attacker adapt but keeps the tasks fixed, so a task stops teaching once the agent solves it. We introduce AdvSim2Real, which co-evolves a task curriculum, an injection adversary, and the agent inside a frozen web world model. The curriculum is rewarded for tasks the agent solves about half of the time, and the adversary only for a success flip, a

领域:cs.CL作者:Sarim Hashmi、Mukul Ranjan、Kshitij Mishra
相关推荐

本站内容由 LLM 精选聚合,原文版权归 arXiv 所有 · 摘录仅供参考