Diagram Analysis for Visually Impaired Readers

We present the first complete software-only framework for making UML class diagrams accessible to visually impaired readers. Existing approaches such as tactile graphics, 3D-printed diagrams, or classifier-based models are either costly, domain-limited, or unable to extract full diagram semantics. In contrast, our system combines formal, shallow semantics, YOLOv8-based object detection, dual OCR text extraction, and a structured query interface. The method automatically reconstructs classes, attributes, methods, and relationships, producing XML and accessible text/audio outputs. Evaluation performed on 379 annotated UML diagrams achieved a mean average precision ([email protected]) of 0.910 across 17 element classes, with precision exceeding $95 \%$ for most components. A feasibility study with a blind engineer confirmed the usability of the query-based interface. This work demonstrates that technical diagrams can be fully and reliably transformed into accessible representations without hardware assistance, opening the way for scalable non-visual access to diagrams across software engineering and related fields.

Authors

Institutions

Publication Details

Published
2025-11-27
DOI
https://doi.org/10.1109/iciip68302.2025.11346210
Citations
1
Primary Topic
Tactile and Sensory Interactions
Type
article
Field-Weighted Citation Impact
1.43
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Diagram Analysis for Visually Impaired Readers

Gaétan Hains, Manpreet Kour, Mohamed Saber
1 citations
Tactile and Sensory Interactions
1.43
article

Diagram Analysis for Visually Impaired Readers

Gaétan Hains, Manpreet Kour, Mohamed Saber
article en
1 citations

Abstract

We present the first complete software-only framework for making UML class diagrams accessible to visually impaired readers. Existing approaches such as tactile graphics, 3D-printed diagrams, or classifier-based models are either costly, domain-limited, or unable to extract full diagram semantics. In contrast, our system combines formal, shallow semantics, YOLOv8-based object detection, dual OCR text extraction, and a structured query interface. The method automatically reconstructs classes, attributes, methods, and relationships, producing XML and accessible text/audio outputs. Evaluation performed on 379 annotated UML diagrams achieved a mean average precision ([email protected]) of 0.910 across 17 element classes, with precision exceeding $95 \%$ for most components. A feasibility study with a blind engineer confirmed the usability of the query-based interface. This work demonstrates that technical diagrams can be fully and reliably transformed into accessible representations without hardware assistance, opening the way for scalable non-visual access to diagrams across software engineering and related fields.

Orange (Poland) (PL), Université Paris-Est Créteil (FR), Paris-Est Sup (FR)
Openalex Percentile: Top 15%
Tactile and Sensory Interactions
1.43
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.