Bridging Precision and Efficiency: Ai-Driven Segmentation and Orientation Correction for Enhanced Protocol Adherence in Teledermatology

Protocol non-adherence in teledermatology, particularly during image acquisition, such as missing rulers or incorrect image orientations, leads to invalid examinations, delayed diagnoses, and increased patient burdens. This study addresses these challenges by evaluating modern neural network architectures for instance segmentation and proposing a novel orientation correction pipeline to improve adherence in two protocols: Approximation (identifying rulers/patient tags) and Panoramic (correcting body orientation errors). Using the Santa Catarina State Telemedicine System dataset (14,238 images for Approximation; 3,692 for Panoramic), models were benchmarked against previous study measuring computational efficiency and precision metrics. Results demonstrate YOLOv11's superiority, achieving state-of-the-art performance with <tex xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">$86.08 \text{AP}_{75}$</tex>, reducing segmentation errors by 14 % compared to Mask R-CNN, while maintaining computational efficiency (1.3 GB VRAM, 566-699 ms latency). For panoramic protocol images, our proposed pipeline mitigated orientation errors by methodically rotating misaligned human masks, improving weighted <tex xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">$F$</tex>-scores from 0.51 to 0.82 and significantly reducing misclassifications between valid and invalid poses. While Mask2Former's transformerbased design architecture exhibited higher precision, the computational demands (11.7 GB VRAM) hindered deployability in low-resource clinics. This study concludes that hybrid models like YOLOv11 optimally balance segmentation accuracy and operational efficiency, offering actionable insights for real-world clinical implementation bridging AI advancements with clinical pragmatism, improving protocol adherence to reduce invalid examinations by addressing orientation inconsistencies in teledermatology.

Authors

Institutions

Publication Details

Published
2025-06-18
DOI
https://doi.org/10.1109/cbms65348.2025.00050
Primary Topic
Cutaneous Melanoma Detection and Management
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Bridging Precision and Efficiency: Ai-Driven Segmentation and Orientation Correction for Enhanced Protocol Adherence in Teledermatology

Aldo von Wangenheim, Luís Otávio Santos, Douglas Dyllon Jerônimo de Macedo, Daniel Holthausen Nunes et al.
Cutaneous Melanoma Detection and Management
article

Bridging Precision and Efficiency: Ai-Driven Segmentation and Orientation Correction for Enhanced Protocol Adherence in Teledermatology

Aldo von Wangenheim, Luís Otávio Santos, Douglas Dyllon Jerônimo de Macedo, Daniel Holthausen Nunes, Rodrigo P. S. Ribeiro, Bibiana Q. Tiellet, Beatriz S. Lopes
article en

Abstract

Protocol non-adherence in teledermatology, particularly during image acquisition, such as missing rulers or incorrect image orientations, leads to invalid examinations, delayed diagnoses, and increased patient burdens. This study addresses these challenges by evaluating modern neural network architectures for instance segmentation and proposing a novel orientation correction pipeline to improve adherence in two protocols: Approximation (identifying rulers/patient tags) and Panoramic (correcting body orientation errors). Using the Santa Catarina State Telemedicine System dataset (14,238 images for Approximation; 3,692 for Panoramic), models were benchmarked against previous study measuring computational efficiency and precision metrics. Results demonstrate YOLOv11's superiority, achieving state-of-the-art performance with <tex xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">$86.08 \text{AP}_{75}$</tex>, reducing segmentation errors by 14 % compared to Mask R-CNN, while maintaining computational efficiency (1.3 GB VRAM, 566-699 ms latency). For panoramic protocol images, our proposed pipeline mitigated orientation errors by methodically rotating misaligned human masks, improving weighted <tex xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">$F$</tex>-scores from 0.51 to 0.82 and significantly reducing misclassifications between valid and invalid poses. While Mask2Former's transformerbased design architecture exhibited higher precision, the computational demands (11.7 GB VRAM) hindered deployability in low-resource clinics. This study concludes that hybrid models like YOLOv11 optimally balance segmentation accuracy and operational efficiency, offering actionable insights for real-world clinical implementation bridging AI advancements with clinical pragmatism, improving protocol adherence to reduce invalid examinations by addressing orientation inconsistencies in teledermatology.

Universidade Federal de Santa Catarina (BR)
Openalex Percentile: Top 76%
Cutaneous Melanoma Detection and Management
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.