A Systematic Survey on Image Description Techniques for STEM Domains
The proliferation of visual data in Science, Technology, Engineering, and Mathematics (STEM) presents accessibility barriers for blind and low-vision users. While Artificial Intelligence (AI) can generate alternative descriptions of STEM images, research remains fragmented and pratical impact is limited. This systematic survey examines 20 peer-reviewed studies on AI-based STEM visual description, focusing on accessibility and Human–Computer Interaction (HCI). Following PRISMA methodology and a ROBIS-based risk-of-bias assessment, the review analyzes (i) STEM visuals targeted, (ii) AI architectures employed, (iii) datasets and evaluation metrics, and (iv) interaction modalities for delivering descriptions. Findings show a shift from static alt-text toward interactive, multimodal systems integrating conversational interfaces, keyboard navigation, audio, and haptic feedback. However, challenges persist, including hallucinations, limited accessibility-first datasets co-designed with BLV users, and overreliance on automatic text-overlap metrics. The survey identifies future HCI priorities: user-controlled verbosity, explainable AI pipelines, and integration of accessible description into mainstream STEM environments.
Authors
- Marco Cardia (ORCID: https://orcid.org/0000-0002-0458-589X)
- Marina Buzzi (ORCID: https://orcid.org/0000-0003-1725-9433)
- Giulio Galesi (ORCID: https://orcid.org/0000-0001-6185-0795)
- Barbara Leporini (ORCID: https://orcid.org/0000-0003-2469-9648)
- Letizia Angileri
Institutions
- University of Pisa (IT)
- Istituto di Scienza e Tecnologie dell'Informazione "Alessandro Faedo" (IT)
- National Academies of Sciences, Engineering, and Medicine (US)
- Institute of Informatics and Telematics (IT)
Publication Details
- Journal
- International Journal of Human-Computer Interaction
- Published
- 2026-05-22
- DOI
- https://doi.org/10.1080/10447318.2026.2668031
- Primary Topic
- Advanced Electron Microscopy Techniques and Applications
- Type
- article
- Field-Weighted Citation Impact
- 0.00