Staged purpose-blinded evaluation of provenance risk from a general-purpose generator in breast ultrasound
Commercial general-purpose image generators may create medical-looking content outside controlled medical-AI research, raising provenance concerns. We evaluated a general-purpose generator that produced breast ultrasound images without medical-specific development or patient-image inputs. The primary scientific component was a purpose-blinded Phase 1 design in which 12 readers assessed 60 images per source without knowing synthetic images were present, measuring pre-verification vulnerability. Crossed reader-and-image models showed higher reader-perceived quality for synthetic images (difference, 0.44; 95% CI, 0.33–0.55) and higher model-estimated sufficiency for basic image-level judgement (95.9% versus 86.7%). Only 3 of 12 readers spontaneously questioned provenance. Phase 2 measured explicit provenance detection (accuracy, 70.8%); a separate cue-supported Phase 3 set without file-level overlap provided exploratory workflow-response signals (accuracy, 79.5%). Readers selected review, verification or non-use in 94.9% of synthetic-image evaluations. This staged acceptance–detection–response framework identifies cross-domain provenance risk but does not establish clinical fidelity, diagnostic equivalence or causal intervention efficacy.
Authors
- Minggang Wu
- Huaying Bo
- Man Lu (ORCID: https://orcid.org/0000-0002-3455-834X)
- Chenyao Gu
- Ziyue Hu (ORCID: https://orcid.org/0000-0003-1368-730X)
- Zhenqi Zhang (ORCID: https://orcid.org/0000-0002-7709-4039)
- Min Zhuang
- Yi Li (ORCID: https://orcid.org/0000-0002-3875-3513)
- Yin Li (ORCID: https://orcid.org/0000-0003-4173-9453)
- Qing Xiao (ORCID: https://orcid.org/0000-0001-8514-4297)
- Yao Fu (ORCID: https://orcid.org/0000-0001-5257-8232)
- Ying Liang
- Yitong Ding
- Xinxin Xian
- Siqi Zhang
- Chaoyang Luo
- Shishi Wang (ORCID: https://orcid.org/0000-0002-6280-3920)
- Chang Liu
- Lu Wang
- Qing Yang
- Jing Zhao
- Jiami Li
- Shuchen Zhang
- Ting Wei
Institutions
- University of Electronic Science and Technology of China (CN)
- The University of Western Australia (AU)
- Dalian Medical University (CN)
- Nantong University (CN)
- Sichuan University (CN)
- West China Hospital of Sichuan University (CN)
- Chengdu Women's and Children's Central Hospital (CN)
- Mianyang Third People's Hospital (CN)
- Second Affiliated Hospital of Dalian Medical University (CN)
- Shanghai Liangyou (China) (CN)
- Sichuan Cancer Hospital (CN)
- Yancheng First People's Hospital (CN)
- Yancheng Third People's Hospital (CN)
- People's Hospital of Bishan District (CN)
- Yancheng Second People's Hospital (CN)
- Sichuan Integrative Medicine Hosipital (CN)
Publication Details
- Journal
- npj Digital Medicine
- Published
- 2026-09-19
- DOI
- https://doi.org/10.1038/s41746-026-03209-w
- Primary Topic
- Artificial Intelligence in Healthcare and Education
- Type
- article
- Field-Weighted Citation Impact
- 0.00