CapTune: Adapting Non-Speech Captions With Anchored Generative Models
Non-speech captions are essential to the video experience of deaf and hard of hearing (DHH) viewers, yet conventional approaches often overlook the diversity of their preferences. We present CapTune, a system that enables customization of non-speech captions based on DHH viewers' needs while preserving creator intent. CapTune allows caption authors to define safe transformation spaces using concrete examples and empowers viewers to personalize captions across four dimensions: level of detail, expressiveness, sound representation method, and genre alignment. Evaluations with seven caption creators and twelve DHH participants showed that CapTune supported creators' creative control while enhancing viewers' emotional engagement with content. Our findings also reveal trade-offs between information richness and cognitive load, tensions between interpretive and descriptive representations of sound, and the context-dependent nature of caption preferences.
Authors
- Caluã de Lacerda Pataca (ORCID: https://orcid.org/0000-0001-5046-9884)
- Liang-Yuan Wu
- Jeremy Zhengqi Huang (ORCID: https://orcid.org/0000-0003-2177-9909)
- Dhruv Jain (ORCID: https://orcid.org/0000-0001-6176-968X)
Institutions
- Rochester Institute of Technology (US)
- University of Michigan (US)
Publication Details
- Published
- 2025-10-22
- DOI
- https://doi.org/10.1145/3663547.3746346
- Citations
- 1
- Primary Topic
- Subtitles and Audiovisual Media
- Type
- article
- Field-Weighted Citation Impact
- 10.42