Enhanced skin tone and blood estimation through AI-enabled upscaling of discrete reflectance spectra

Objective quantification of epidermal melanin content and dermal blood volume is crucial for equitable applications in dermatology and in the evaluation and engineering of optical devices, such as pulse oximeters, where variable amounts of melanin may introduce inaccuracies. Here, we demonstrate a method leveraging diffuse reflectance spectroscopy and a machine-learning framework using fully connected neural networks (FCNNs) to non-invasively estimate melanin and blood indices from sparse data through spectral upscaling. We validated the algorithm on custom phantoms, porcine skin, and in vivo human participants. In phantoms with variable blood and melanin (0–20%), the model achieved high accuracy ( R 2 > 0.90) to absolute concentrations. In porcine skin, estimated melanin strongly correlated with histology-derived density scores (Pearson r = 0.95). Across six regions of the human hand, the FCNN accurately estimated pigmentation from sparse wavelengths, even during hand-raise challenges that induce confounding blood volume changes. After upscaling, sparse-wavelength estimates strongly correlated with a model using over 450 wavelengths (Pearson r = 0.96), reducing data requirements ~ 150-fold without compromising accuracy. These findings highlight the importance of high-spectral information for disentangling melanin and blood contributions in reflectance spectra and the capacity of machine-learning to restore predictive performance from sparse inputs. These findings demonstrate that artificial-intelligence -driven spectral upscaling can enhance objective skin tone quantification in wearable optical devices.

Authors

Institutions

Publication Details

Journal
npj Digital Medicine
Published
2026-11-13
DOI
https://doi.org/10.1038/s41746-026-03429-0
Primary Topic
Optical Imaging and Spectroscopy Techniques
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Enhanced skin tone and blood estimation through AI-enabled upscaling of discrete reflectance spectra

Jonathan Wu, Daniel Franklin, Heather Joan Ross, Michael Butler et al.
2 links
npj Digital Medicine
Optical Imaging and Spectroscopy Techniques
article

Enhanced skin tone and blood estimation through AI-enabled upscaling of discrete reflectance spectra

Jonathan Wu, Daniel Franklin, Heather Joan Ross, Michael Butler, Megh Rathod, Sara Saffari, Noor Abu Jarad, Leonid Shmuylovich, Isha Sharma, Mitchell Andrew Pet, Samantha Unger, Matthew Lee
article en

Abstract

Objective quantification of epidermal melanin content and dermal blood volume is crucial for equitable applications in dermatology and in the evaluation and engineering of optical devices, such as pulse oximeters, where variable amounts of melanin may introduce inaccuracies. Here, we demonstrate a method leveraging diffuse reflectance spectroscopy and a machine-learning framework using fully connected neural networks (FCNNs) to non-invasively estimate melanin and blood indices from sparse data through spectral upscaling. We validated the algorithm on custom phantoms, porcine skin, and in vivo human participants. In phantoms with variable blood and melanin (0–20%), the model achieved high accuracy ( R 2 > 0.90) to absolute concentrations. In porcine skin, estimated melanin strongly correlated with histology-derived density scores (Pearson r = 0.95). Across six regions of the human hand, the FCNN accurately estimated pigmentation from sparse wavelengths, even during hand-raise challenges that induce confounding blood volume changes. After upscaling, sparse-wavelength estimates strongly correlated with a model using over 450 wavelengths (Pearson r = 0.96), reducing data requirements ~ 150-fold without compromising accuracy. These findings highlight the importance of high-spectral information for disentangling melanin and blood contributions in reflectance spectra and the capacity of machine-learning to restore predictive performance from sparse inputs. These findings demonstrate that artificial-intelligence -driven spectral upscaling can enhance objective skin tone quantification in wearable optical devices.

npj Digital Medicine
University Health Network (CA), University of Toronto (CA), Washington University in St. Louis (US), Ted Rogers Centre for Heart Research (CA)
Tampa Bay Estuary Program, National Institutes of Health, Canadian Institutes of Health Research
Good health and well-being
Optical Imaging and Spectroscopy Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon