Enhanced skin tone and blood estimation through AI-enabled upscaling of discrete reflectance spectra
Objective quantification of epidermal melanin content and dermal blood volume is crucial for equitable applications in dermatology and in the evaluation and engineering of optical devices, such as pulse oximeters, where variable amounts of melanin may introduce inaccuracies. Here, we demonstrate a method leveraging diffuse reflectance spectroscopy and a machine-learning framework using fully connected neural networks (FCNNs) to non-invasively estimate melanin and blood indices from sparse data through spectral upscaling. We validated the algorithm on custom phantoms, porcine skin, and in vivo human participants. In phantoms with variable blood and melanin (0–20%), the model achieved high accuracy ( R 2 > 0.90) to absolute concentrations. In porcine skin, estimated melanin strongly correlated with histology-derived density scores (Pearson r = 0.95). Across six regions of the human hand, the FCNN accurately estimated pigmentation from sparse wavelengths, even during hand-raise challenges that induce confounding blood volume changes. After upscaling, sparse-wavelength estimates strongly correlated with a model using over 450 wavelengths (Pearson r = 0.96), reducing data requirements ~ 150-fold without compromising accuracy. These findings highlight the importance of high-spectral information for disentangling melanin and blood contributions in reflectance spectra and the capacity of machine-learning to restore predictive performance from sparse inputs. These findings demonstrate that artificial-intelligence -driven spectral upscaling can enhance objective skin tone quantification in wearable optical devices.
Authors
- Jonathan Wu (ORCID: https://orcid.org/0009-0002-4786-786X)
- Daniel Franklin (ORCID: https://orcid.org/0000-0002-6453-5114)
- Heather Joan Ross (ORCID: https://orcid.org/0000-0003-4384-3027)
- Michael Butler
- Megh Rathod
- Sara Saffari (ORCID: https://orcid.org/0009-0003-3795-2494)
- Noor Abu Jarad (ORCID: https://orcid.org/0009-0001-9351-446X)
- Leonid Shmuylovich (ORCID: https://orcid.org/0000-0001-9210-7873)
- Isha Sharma (ORCID: https://orcid.org/0000-0002-5332-3642)
- Mitchell Andrew Pet (ORCID: https://orcid.org/0000-0002-5072-1733)
- Samantha Unger (ORCID: https://orcid.org/0009-0003-2944-2005)
- Matthew Lee
Institutions
- University Health Network (CA)
- University of Toronto (CA)
- Washington University in St. Louis (US)
- Ted Rogers Centre for Heart Research (CA)
Publication Details
- Journal
- npj Digital Medicine
- Published
- 2026-11-13
- DOI
- https://doi.org/10.1038/s41746-026-03429-0
- Primary Topic
- Optical Imaging and Spectroscopy Techniques
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- Tampa Bay Estuary Program
- National Institutes of Health
- Canadian Institutes of Health Research