A medical image captioning system for TeleOTIVA: Supporting SDGs-oriented cervical precancer screening in Indonesia

Cervical cancer screening using Visual Inspection with Acetic Acid (VIA) remains a critical strategy in resource-limited settings. However, its effectiveness is often hindered by diagnostic variability arising from subjective interpretation. To address this challenge, we introduce TeleOTIVA, an AI-powered system designed to automatically detect and describe cervical lesions from VIA images. The system integrates YOLOv11-based lesion detection and segmentation with a Dense Residual Network and an embedding LSTM-based image captioning module, enabling it to generate clinically meaningful descriptions encompassing lesion borders, surface texture, and anatomical location. The performance of TeleOTIVA demonstrates promising results. Evaluations of the generated captions, compared to expert-annotated ground truth, yielded high scores across multiple metrics: BLEU (0.5711), METEOR (0.6726), and ROUGE-L (0.6929). These results indicate a high degree of n-gram similarity, semantic relevance, grammatical accuracy, and structural alignment with human-generated descriptions. In other words, the model not only mirrors expert-level vocabulary but also captures the clinical essence of VIA image interpretation. This synergy between advanced lesion detection and automated caption generation significantly enhances the accuracy, efficiency, and accessibility of cervical cancer screening. TeleOTIVA thus offers a powerful and scalable diagnostic aid, particularly impactful for improving early detection efforts in underserved and low-resource regions.

Authors

Publication Details

Journal
Informatics in Medicine Unlocked
Published
2025-12-04
DOI
https://doi.org/10.1016/j.imu.2025.101719
Primary Topic
Multimodal Machine Learning Applications
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A medical image captioning system for TeleOTIVA: Supporting SDGs-oriented cervical precancer screening in Indonesia

Rizal Sanif, Radiyati Umi Partan, Akhiar Wista Arum, Ade Iriani Sapitri et al.
Informatics in Medicine Unlocked
Multimodal Machine Learning Applications
article

A medical image captioning system for TeleOTIVA: Supporting SDGs-oriented cervical precancer screening in Indonesia

Rizal Sanif, Radiyati Umi Partan, Akhiar Wista Arum, Ade Iriani Sapitri, Annisa Darmawahyuni, Bambang Tutuko, Patiyus Agustiansyah, Muhammad Naufal Rachmatullah, Elly Matul Imah, Anggun Islami, Siti Nurmaini, Firdaus Firdaus, Rizki Ayunda Pratama
article en

Abstract

Cervical cancer screening using Visual Inspection with Acetic Acid (VIA) remains a critical strategy in resource-limited settings. However, its effectiveness is often hindered by diagnostic variability arising from subjective interpretation. To address this challenge, we introduce TeleOTIVA, an AI-powered system designed to automatically detect and describe cervical lesions from VIA images. The system integrates YOLOv11-based lesion detection and segmentation with a Dense Residual Network and an embedding LSTM-based image captioning module, enabling it to generate clinically meaningful descriptions encompassing lesion borders, surface texture, and anatomical location. The performance of TeleOTIVA demonstrates promising results. Evaluations of the generated captions, compared to expert-annotated ground truth, yielded high scores across multiple metrics: BLEU (0.5711), METEOR (0.6726), and ROUGE-L (0.6929). These results indicate a high degree of n-gram similarity, semantic relevance, grammatical accuracy, and structural alignment with human-generated descriptions. In other words, the model not only mirrors expert-level vocabulary but also captures the clinical essence of VIA image interpretation. This synergy between advanced lesion detection and automated caption generation significantly enhances the accuracy, efficiency, and accessibility of cervical cancer screening. TeleOTIVA thus offers a powerful and scalable diagnostic aid, particularly impactful for improving early detection efforts in underserved and low-resource regions.

Informatics in Medicine UnlockedVol. 60
Openalex Percentile: Top 60%
Multimodal Machine Learning Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.