Improving the Realism of Synthetic Clinical Benchmarks Under Utility Constraints· 提高合成临床基准的真实性
Synthetic clinical benchmarks for enterprise AI agents can pass existing utility checks and still remain structurally unrealistic, especially in privacy-sensitive healthcare settings where operational data are hard to access. We study how to improve such benchmarks without breaking the downstream utility checks already used in practice. We formulate benchmark revision as utility-constrained realism improvement: dataset changes should increase realism while staying above an operational utility floor. We instantiate this idea on a care-gap benchmark derived from Synthea-generated patients exercised through demonstration electronic health record workflows and then processed by the same downstream pipeline as operational data. Realism is measured through missingness structure, simplicity, stru
提高隐私敏感的合成临床数据基准的真实性,同时保持其实用价值。
- 核心方法
- 提出一种实用约束下的真实性改进方法,通过调整数据集来提高合成数据的真实感,同时确保其不降低实际操作中的实用性。
- 适合谁读
- 研究者、工程师
- 要解决的问题
- 现有的合成临床数据基准虽然通过了实用性检查,但在隐私敏感的医疗环境中仍缺乏结构真实性。
- 关键实验
- 在基于Synthea生成的患者数据集上进行了实验,通过演示电子健康记录工作流程和与实际运营数据相同的下游处理管道来评估方法的有效性。
- 主要贡献
- 提供了一种在保持数据实用性的同时提高合成临床数据基准真实性的方法框架。
- 意义与局限
- 该研究有助于提高合成临床数据的可用性和可信度,对隐私敏感的医疗AI应用具有重要意义;但具体方法的有效性和普适性仍需更多验证。