Toward Language Justice: Exploring Multilingual Captioning for Accessibility

A growing body of research investigates how to make captioning experiences more accessible and enjoyable to disabled people. However, prior work has focused largely on English captioning, neglecting the majority of people who are multilingual (i.e., understand or express themselves in more than one language). To address this gap, we conducted semi-structured interviews and diary logs with 13 participants who used multilingual captions for accessibility. Our findings highlight the linguistic and cultural dimensions of captioning, detailing how language features (scripts and orthography) and the inclusion/negation of cultural context shape the accessibility of captions. Despite lack of quality and availability, participants emphasized the importance of multilingual captioning to learn a new language, build community, and preserve cultural heritage. Moving toward a future where all ways of communicating are celebrated, we present ways to orient captioning research to a language justice agenda that decenters English and engages with varied levels of fluency.

Authors

Institutions

Publication Details

Published
2025-04-24
DOI
https://doi.org/10.1145/3706598.3713622
Citations
6
Primary Topic
Subtitles and Audiovisual Media
Type
article
Field-Weighted Citation Impact
62.54
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Toward Language Justice: Exploring Multilingual Captioning for Accessibility

Stacy Hsueh, Rahaf Alharbi, Aashaka Desai, Jennifer Mankoff et al.
6 citations
Subtitles and Audiovisual Media
62.54
article

Toward Language Justice: Exploring Multilingual Captioning for Accessibility

Stacy Hsueh, Rahaf Alharbi, Aashaka Desai, Jennifer Mankoff, Richard E. Ladner
article en
6 citations

Abstract

A growing body of research investigates how to make captioning experiences more accessible and enjoyable to disabled people. However, prior work has focused largely on English captioning, neglecting the majority of people who are multilingual (i.e., understand or express themselves in more than one language). To address this gap, we conducted semi-structured interviews and diary logs with 13 participants who used multilingual captions for accessibility. Our findings highlight the linguistic and cultural dimensions of captioning, detailing how language features (scripts and orthography) and the inclusion/negation of cultural context shape the accessibility of captions. Despite lack of quality and availability, participants emphasized the importance of multilingual captioning to learn a new language, build community, and preserve cultural heritage. Moving toward a future where all ways of communicating are celebrated, we present ways to orient captioning research to a language justice agenda that decenters English and engages with varied levels of fluency.

Vol. 2025
University of Washington (US), University of Michigan (US)
Quality Education
Openalex Percentile: Top 0%
Subtitles and Audiovisual Media
62.54
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.