Designing evaluation rubrics for the development of virtual human twins in healthcare

Abstract Objectives Smart healthcare innovations driven by Virtual Human Twin (VHT) technology enable continuous patient monitoring. However, standards to assess their stage of development or a unified framework for performance comparisons are still lacking. This study aims to quantitatively analyze VHT-related studies, evaluate their development levels, and align them to the VHT roadmap. Materials and methods A systematic review guided by the PRISMA methodology was conducted, in which 26 studies representing different stages of VHT development were systematically analyzed. Articles were evaluated against an established 5-level roadmap and classified according to their closest alignment with black box, grey box, or surrogate VHTs. Results A rubric system was developed to assess VHT models to date, and their maturity was analyzed relative to the established roadmap. Among the 26 studies, all 5 roadmap levels were represented. Level 2 (Deductive stage) was the most frequently represented. Levels 4 and 5 (Evolutionary and Explainable stages) were represented only in 3 studies each. Discussion Among the included studies, VHT development appears fragmented, with significant hurdles in building VHTs with advanced functionality. Conclusion The proposed rubric system may serve as an assessment tool to evaluate progress, encourage discussion, and improve experimental approaches for future VHTs, helping address challenges in advancing VHT development along the established roadmap.

Authors

Institutions

Publication Details

Journal
Journal of the American Medical Informatics Association
Published
2026-10-19
DOI
https://doi.org/10.1093/jamia/ocag174
Primary Topic
Artificial Intelligence in Healthcare and Education
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Designing evaluation rubrics for the development of virtual human twins in healthcare

Vaishnavi Krishnamurthi, Magdalena Plebanski, Ruwini Kodikara Edirisinghe, Nilmini S. Wickramasinghe et al.
Journal of the American Medical Informatics Association
Artificial Intelligence in Healthcare and Education
article

Designing evaluation rubrics for the development of virtual human twins in healthcare

Vaishnavi Krishnamurthi, Magdalena Plebanski, Ruwini Kodikara Edirisinghe, Nilmini S. Wickramasinghe, Sam E John
article en

Abstract

Abstract Objectives Smart healthcare innovations driven by Virtual Human Twin (VHT) technology enable continuous patient monitoring. However, standards to assess their stage of development or a unified framework for performance comparisons are still lacking. This study aims to quantitatively analyze VHT-related studies, evaluate their development levels, and align them to the VHT roadmap. Materials and methods A systematic review guided by the PRISMA methodology was conducted, in which 26 studies representing different stages of VHT development were systematically analyzed. Articles were evaluated against an established 5-level roadmap and classified according to their closest alignment with black box, grey box, or surrogate VHTs. Results A rubric system was developed to assess VHT models to date, and their maturity was analyzed relative to the established roadmap. Among the 26 studies, all 5 roadmap levels were represented. Level 2 (Deductive stage) was the most frequently represented. Levels 4 and 5 (Evolutionary and Explainable stages) were represented only in 3 studies each. Discussion Among the included studies, VHT development appears fragmented, with significant hurdles in building VHTs with advanced functionality. Conclusion The proposed rubric system may serve as an assessment tool to evaluate progress, encourage discussion, and improve experimental approaches for future VHTs, helping address challenges in advancing VHT development along the established roadmap.

Journal of the American Medical Informatics Association
Deakin University (AU), The University of Melbourne (AU), La Trobe University (AU), MIT University (MK), RMIT University (AU)
Openalex Percentile: Top 20%
Artificial Intelligence in Healthcare and Education
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.