\textsc{TestifAI}: Tomography-Based Testing for Deep Learning Systems· TestifAI:基于断层扫描的深度学习系统测试
As AI systems are increasingly deployed in safety-critical application domains (e.g., autonomous driving), associated risks increase too. Deep learning models underlying modern AI systems, therefore, must undergo thorough testing to ensure their correct behaviour. A single robustness test involves thousands of inferences to empirically verify if a model's outputs remain stable under a bounded perturbation of its inputs. However, existing testing frameworks lack the means to systematically explore and summarise robustness across a combinatorial space of perturbations. We propose TestifAI, a deep learning testing framework for efficient and accurate estimation of robustness against combinations of perturbations. TestifAI enables users to specify operational conditions as structured spaces of
基于断层扫描技术,提出了一种高效测试深度学习系统鲁棒性的框架TestifAI。
- 核心方法
- TestifAI框架通过结构化的方式指定操作条件,能够系统地探索和总结模型在不同输入扰动下的表现,提供高效且准确的鲁棒性估计。
- 适合谁读
- 研究者 / 工程师
- 要解决的问题
- 随着AI系统在安全关键领域的应用增加,需要解决深度学习模型在面对输入扰动组合空间时的系统性测试与鲁棒性评估问题。
- 关键实验
- 通过在多个深度学习模型上的实验验证了TestifAI的有效性和准确性,特别是在面对复杂输入扰动时的表现。
- 主要贡献
- 首次提出了一种基于断层扫描技术的深度学习系统测试方法,能够处理大规模扰动组合,提高了测试效率和准确性。
- 意义与局限
- TestifAI有助于提高深度学习系统的鲁棒性和安全性,但在实际应用中可能仍面临计算资源和时间成本的挑战。