Generalizability assessment of AI models across hospitals in a low-middle and high income country

The integration of artificial intelligence (AI) into healthcare systems within low-middle income countries (LMICs) has emerged as a central focus for various initiatives aiming to improve healthcare access and delivery quality. In contrast to high-income countries (HICs), which often possess the resources and infrastructure to adopt innovative healthcare technologies, LMICs confront resource limitations such as insufficient funding, outdated infrastructure, limited digital data, and a shortage of technical expertise. Consequently, many algorithms initially trained on data from non-LMIC settings are now being employed in LMIC contexts. However, the effectiveness of these systems in LMICs can be compromised when the unique local contexts and requirements are not adequately considered. In this study, we evaluate the feasibility of utilizing models developed in the United Kingdom (a HIC) within hospitals in Vietnam (a LMIC). Consequently, we present and discuss practical methodologies aimed at improving model performance, emphasizing the critical importance of tailoring solutions to the distinct healthcare systems found in LMICs. Our findings emphasize the necessity for collaborative initiatives and solutions that are sensitive to the local context in order to effectively tackle the healthcare challenges that are unique to these regions.

Authors

Institutions

Publication Details

Journal
Nature Communications
Published
2024-09-27
DOI
https://doi.org/10.1038/s41467-024-52618-6
Citations
66
Primary Topic
Artificial Intelligence in Healthcare and Education
Type
article
Field-Weighted Citation Impact
7.94

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Generalizability assessment of AI models across hospitals in a low-middle and high income country

Andrew A. S. Soltan, Nguyễn Thanh Phong, Jenny Yang, David A. Clifton et al.
66 citations
Nature Communications
Artificial Intelligence in Healthcare and Education
7.94
article

Generalizability assessment of AI models across hospitals in a low-middle and high income country

Andrew A. S. Soltan, Nguyễn Thanh Phong, Jenny Yang, David A. Clifton, Lam Minh Yen, Louise Thwaites, Vu Dinh Phu, Doan Bui Xuan Thy, Khiem Dong Phu, Phạm Ngọc Thạch, Nguyen Thanh Dung
article en
66 citations

Abstract

The integration of artificial intelligence (AI) into healthcare systems within low-middle income countries (LMICs) has emerged as a central focus for various initiatives aiming to improve healthcare access and delivery quality. In contrast to high-income countries (HICs), which often possess the resources and infrastructure to adopt innovative healthcare technologies, LMICs confront resource limitations such as insufficient funding, outdated infrastructure, limited digital data, and a shortage of technical expertise. Consequently, many algorithms initially trained on data from non-LMIC settings are now being employed in LMIC contexts. However, the effectiveness of these systems in LMICs can be compromised when the unique local contexts and requirements are not adequately considered. In this study, we evaluate the feasibility of utilizing models developed in the United Kingdom (a HIC) within hospitals in Vietnam (a LMIC). Consequently, we present and discuss practical methodologies aimed at improving model performance, emphasizing the critical importance of tailoring solutions to the distinct healthcare systems found in LMICs. Our findings emphasize the necessity for collaborative initiatives and solutions that are sensitive to the local context in order to effectively tackle the healthcare challenges that are unique to these regions.

Nature CommunicationsVol. 15(1)
University of Oxford (GB), Science Oxford (GB), Oxford University Hospitals NHS Trust (GB), Oxford University Clinical Research Unit (VN), Jenner Institute (GB), Hospital for Tropical Diseases (VN)
Wellcome Trust, National Institute for Health and Care Research, Royal Academy of Engineering, University of Oxford, European Commission, Oxford University Hospitals NHS Foundation Trust, Horizon 2020 Framework Programme, Medical Research Council
Openalex Percentile: Top 2%
Artificial Intelligence in Healthcare and Education
7.94
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.