Falling Behind Drives Unsafe Development in an Idealised AI Race Experiment· 落后推动理想化 AI 竞赛中的不安全开发
Technological races create tension between speed and safety: actors may gain by moving faster than competitors, even when risky development is harmful. This is prominent in debates about artificial intelligence (AI), where competitive pressure is often argued to incentivise riskier, less safety-conscious development. We study this using a framed behavioural experiment based on an idealised AI race, in which paired participants repeatedly chose between Safe and Unsafe development under an uncertain time horizon. Unsafe development gave faster progress and higher immediate payoffs but accumulated private risk up to a treatment-specific maximum of 10\%, 60\%, or 90\%; the race's competitive structure was held constant, and only this maximum risk varied. Neither the pre-registered comparison b
理想化 AI 竞赛实验揭示落后者更可能采取不安全的开发方式。
- 核心方法
- 设计了一个基于理想化 AI 竞赛的行为实验，让成对的参与者在不确定的时间范围内反复选择安全或不安全的开发方法。
- 适合谁读
- 研究者、政策制定者
- 要解决的问题
- 研究 AI 竞赛中，竞争压力如何影响开发者的安全与速度权衡。
- 关键实验
- 参与者在三种不同的最大私人风险条件下（10%，60%，90%）进行实验，研究不同风险水平下的选择行为。
- 主要贡献
- 实验结果表明，落后者更倾向于采用不安全的开发策略以获得即时收益和更快的进展。
- 意义与局限
- 该研究揭示了 AI 开发中的竞争压力可能导致不安全行为的增加，为政策制定和行业规范提供了参考。但实验条件较为理想化，可能与实际情况有所偏差。