“Choices? That's the dream”: challenges and opportunities in non-speech information closed-captioning
Introduction Access to non-speech information (NSI) in video content is essential to creating accessible and engaging video content, particularly for D/deaf and Hard-of-Hearing (DHH) audiences. In this paper we present an overview of the current state of NSI captioning research, professional practice, and user preferences. Methods We utilized a comprehensive review approach that combined a systematic literature review methodology with a mixed-methods survey and interview study. 1276 papers were screened with 36 eligible for the final inductive best fit analysis. 168 DHH participants completed an online survey and 15 participated in semi-structured interviews. Additionally, 5 professional captioners participated in semi-structured interviews. Results and discussion We offer systematic insights into the current challenges related to NSI captioning faced by DHH users and professional captioners, trends in recent NSI captioning research, as well as opportunities for future work that enhance user agency, utilize integrated research methodologies, and broaden community involvement.
Authors
- Sripathi Sridhar (ORCID: https://orcid.org/0000-0001-9761-3564)
- Magdalena Fuentes (ORCID: https://orcid.org/0000-0003-4506-6639)
- Keita Ohshiro (ORCID: https://orcid.org/0000-0001-8612-1898)
- Khang Dang (ORCID: https://orcid.org/0000-0003-3481-497X)
- Mark Cartwright (ORCID: https://orcid.org/0000-0002-5908-390X)
- Lloyd May (ORCID: https://orcid.org/0000-0003-4692-8261)
- Michael A. Clemens (ORCID: https://orcid.org/0000-0003-1354-0965)
- Sooyeon Lee (ORCID: https://orcid.org/0000-0002-4971-2004)
- Pauline Wee
Institutions
- New Jersey Institute of Technology (US)
- New York University (US)
- Stanford University (US)
Publication Details
- Journal
- Frontiers in Computer Science
- Published
- 2025-06-19
- DOI
- https://doi.org/10.3389/fcomp.2025.1575176
- Primary Topic
- Subtitles and Audiovisual Media
- Type
- article
- Field-Weighted Citation Impact
- 0.00