Toward automated regulatory decision-making: AI-assisted medical device risk classification with multimodal transformers and self-training

Accurate classification of medical device risk levels is essential for regulatory oversight and clinical safety. Manual classification is labour-intensive and prone to inconsistency, creating bottlenecks in regulatory processes. To address this, we introduce a Transformer-based multimodal framework trained on a real-world corpus of 1,005 Chinese NMPA-registered devices with paired narratives and product images. Our model integrates textual and visual modalities through a cross-attention mechanism and employs a confidence-based self-training loop to enhance generalization under limited supervision. Under 5-fold stratified cross-validation, the best multimodal configuration (SVM with self-training) achieves 91.6% accuracy, 98.86% AUROC, and 87.5% F1, substantially outperforming unimodal baselines (78.4% accuracy text-only; 51.5% accuracy image-only). Ablation studies confirm the complementary benefits of cross-modal attention and robustness analyses show that text-only predictions remain competitive when images are unavailable. Beyond technical gains, we highlight applications in AI-assisted regulatory triage, compliance verification, and support for UDI and GMDN-based device matching within the NMPA context. While validated on Chinese regulatory data, the framework is not assumed to generalize to FDA or EMA contexts without jurisdiction-specific retraining and validation. Our findings suggest that domain-adapted multimodal models, when designed with transparency and calibration, can serve as supporting tools for pre-compliance triage within the originating regulatory jurisdiction.

Authors

Institutions

Publication Details

Journal
Expert Systems with Applications
Published
2026-02-26
DOI
https://doi.org/10.1016/j.eswa.2026.131669
Primary Topic
Artificial Intelligence in Healthcare and Education
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Toward automated regulatory decision-making: AI-assisted medical device risk classification with multimodal transformers and self-training

Yu Han, Jeroen Bergmann, Aaron Ceross
Expert Systems with Applications
Artificial Intelligence in Healthcare and Education
article

Toward automated regulatory decision-making: AI-assisted medical device risk classification with multimodal transformers and self-training

Yu Han, Jeroen Bergmann, Aaron Ceross
article en

Abstract

Accurate classification of medical device risk levels is essential for regulatory oversight and clinical safety. Manual classification is labour-intensive and prone to inconsistency, creating bottlenecks in regulatory processes. To address this, we introduce a Transformer-based multimodal framework trained on a real-world corpus of 1,005 Chinese NMPA-registered devices with paired narratives and product images. Our model integrates textual and visual modalities through a cross-attention mechanism and employs a confidence-based self-training loop to enhance generalization under limited supervision. Under 5-fold stratified cross-validation, the best multimodal configuration (SVM with self-training) achieves 91.6% accuracy, 98.86% AUROC, and 87.5% F1, substantially outperforming unimodal baselines (78.4% accuracy text-only; 51.5% accuracy image-only). Ablation studies confirm the complementary benefits of cross-modal attention and robustness analyses show that text-only predictions remain competitive when images are unavailable. Beyond technical gains, we highlight applications in AI-assisted regulatory triage, compliance verification, and support for UDI and GMDN-based device matching within the NMPA context. While validated on Chinese regulatory data, the framework is not assumed to generalize to FDA or EMA contexts without jurisdiction-specific retraining and validation. Our findings suggest that domain-adapted multimodal models, when designed with transparency and calibration, can serve as supporting tools for pre-compliance triage within the originating regulatory jurisdiction.

Expert Systems with ApplicationsVol. 318
University of Southern Denmark (DK), University of Oxford (GB), University of Birmingham (GB)
Peace, Justice and strong institutions
Openalex Percentile: Top 44%
Artificial Intelligence in Healthcare and Education
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.