Deep Automatic Alignment of Mpox Dermatological Hand Photography
Mpox is a viral illness with heavy cutaneous involvement. Automatic tracking of mpox lesion progression is critical in determining the resolution of evolving lesions. This work introduces a novel application of deep learning for lesion monitoring through alignment of dermatological hand photographs. By adapting the VoxelMorph framework for 2D photographic data, we explore key point alignment across serial images. We trained our neural network model on a unique dataset of 1,658 hand images and evaluated its performance on a test set of 254 images. Additionally, we validated the method's generalizability with a supplementary set of 500 images, which included extensive Mpox infection. Our findings indicate modest yet significant improvements in key points and lesion center registration across different regularization strengths. Although promising, the complexity of hand structure presents challenges, requiring cautious application and further refinement, especially in regions with intense spatial discontinuities, such as interdigital areas.
Authors
- Benoît M. Dawant (ORCID: https://orcid.org/0000-0002-3804-8400)
- Andrew McNeil (ORCID: https://orcid.org/0000-0003-1496-9691)
- Lori E. Dodd (ORCID: https://orcid.org/0000-0002-3433-5429)
- Eric R. Tkaczyk (ORCID: https://orcid.org/0000-0002-2850-4740)
- Véronique Nussenblatt (ORCID: https://orcid.org/0000-0002-9530-0131)
- Inga Saknīte (ORCID: https://orcid.org/0000-0002-4000-5485)
- Placide Mbala‐Kingebeni (ORCID: https://orcid.org/0000-0003-1556-3570)
- Daniel Moyer (ORCID: https://orcid.org/0000-0003-4428-5012)
- Bennett A. Landman (ORCID: https://orcid.org/0000-0001-5733-2127)
- Olivier Tshiani Mbaya (ORCID: https://orcid.org/0000-0003-1908-5190)
- Gaurav Rudravaram (ORCID: https://orcid.org/0009-0001-9087-462X)
- Tyra Silaphet
- Yihao Liu (ORCID: https://orcid.org/0000-0001-9874-0602)
- Bohan Jiang
- Rachel B. Weiss
Institutions
- Vanderbilt University (US)
- National Institute of Allergy and Infectious Diseases (US)
- National Institute of Biomedical Research (CD)
- Vanderbilt University Medical Center (US)
Publication Details
- Published
- 2025-04-14
- DOI
- https://doi.org/10.1109/isbi60581.2025.10981147
- Primary Topic
- Poxvirus research and outbreaks
- Type
- article
- Field-Weighted Citation Impact
- 0.00