A medical image captioning system for TeleOTIVA: Supporting SDGs-oriented cervical precancer screening in Indonesia
Cervical cancer screening using Visual Inspection with Acetic Acid (VIA) remains a critical strategy in resource-limited settings. However, its effectiveness is often hindered by diagnostic variability arising from subjective interpretation. To address this challenge, we introduce TeleOTIVA, an AI-powered system designed to automatically detect and describe cervical lesions from VIA images. The system integrates YOLOv11-based lesion detection and segmentation with a Dense Residual Network and an embedding LSTM-based image captioning module, enabling it to generate clinically meaningful descriptions encompassing lesion borders, surface texture, and anatomical location. The performance of TeleOTIVA demonstrates promising results. Evaluations of the generated captions, compared to expert-annotated ground truth, yielded high scores across multiple metrics: BLEU (0.5711), METEOR (0.6726), and ROUGE-L (0.6929). These results indicate a high degree of n-gram similarity, semantic relevance, grammatical accuracy, and structural alignment with human-generated descriptions. In other words, the model not only mirrors expert-level vocabulary but also captures the clinical essence of VIA image interpretation. This synergy between advanced lesion detection and automated caption generation significantly enhances the accuracy, efficiency, and accessibility of cervical cancer screening. TeleOTIVA thus offers a powerful and scalable diagnostic aid, particularly impactful for improving early detection efforts in underserved and low-resource regions.
Authors
- Rizal Sanif
- Radiyati Umi Partan (ORCID: https://orcid.org/0000-0001-5853-2112)
- Akhiar Wista Arum
- Ade Iriani Sapitri (ORCID: https://orcid.org/0000-0003-4796-1901)
- Annisa Darmawahyuni (ORCID: https://orcid.org/0000-0002-0229-5717)
- Bambang Tutuko (ORCID: https://orcid.org/0000-0002-2051-8988)
- Patiyus Agustiansyah (ORCID: https://orcid.org/0000-0002-6438-3050)
- Muhammad Naufal Rachmatullah (ORCID: https://orcid.org/0000-0003-3553-3475)
- Elly Matul Imah (ORCID: https://orcid.org/0000-0003-1008-4837)
- Anggun Islami (ORCID: https://orcid.org/0009-0001-3065-2873)
- Siti Nurmaini (ORCID: https://orcid.org/0000-0002-8024-2952)
- Firdaus Firdaus
- Rizki Ayunda Pratama
Publication Details
- Journal
- Informatics in Medicine Unlocked
- Published
- 2025-12-04
- DOI
- https://doi.org/10.1016/j.imu.2025.101719
- Primary Topic
- Multimodal Machine Learning Applications
- Type
- article
- Field-Weighted Citation Impact
- 0.00