CapTune: Adapting Non-Speech Captions With Anchored Generative Models

Non-speech captions are essential to the video experience of deaf and hard of hearing (DHH) viewers, yet conventional approaches often overlook the diversity of their preferences. We present CapTune, a system that enables customization of non-speech captions based on DHH viewers' needs while preserving creator intent. CapTune allows caption authors to define safe transformation spaces using concrete examples and empowers viewers to personalize captions across four dimensions: level of detail, expressiveness, sound representation method, and genre alignment. Evaluations with seven caption creators and twelve DHH participants showed that CapTune supported creators' creative control while enhancing viewers' emotional engagement with content. Our findings also reveal trade-offs between information richness and cognitive load, tensions between interpretive and descriptive representations of sound, and the context-dependent nature of caption preferences.

Authors

Institutions

Publication Details

Published
2025-10-22
DOI
https://doi.org/10.1145/3663547.3746346
Citations
1
Primary Topic
Subtitles and Audiovisual Media
Type
article
Field-Weighted Citation Impact
10.42
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

CapTune: Adapting Non-Speech Captions With Anchored Generative Models

Caluã de Lacerda Pataca, Liang-Yuan Wu, Jeremy Zhengqi Huang, Dhruv Jain
1 citations
Subtitles and Audiovisual Media
10.42
article

CapTune: Adapting Non-Speech Captions With Anchored Generative Models

Caluã de Lacerda Pataca, Liang-Yuan Wu, Jeremy Zhengqi Huang, Dhruv Jain
article en
1 citations

Abstract

Non-speech captions are essential to the video experience of deaf and hard of hearing (DHH) viewers, yet conventional approaches often overlook the diversity of their preferences. We present CapTune, a system that enables customization of non-speech captions based on DHH viewers' needs while preserving creator intent. CapTune allows caption authors to define safe transformation spaces using concrete examples and empowers viewers to personalize captions across four dimensions: level of detail, expressiveness, sound representation method, and genre alignment. Evaluations with seven caption creators and twelve DHH participants showed that CapTune supported creators' creative control while enhancing viewers' emotional engagement with content. Our findings also reveal trade-offs between information richness and cognitive load, tensions between interpretive and descriptive representations of sound, and the context-dependent nature of caption preferences.

Rochester Institute of Technology (US), University of Michigan (US)
Openalex Percentile: Top 2%
Subtitles and Audiovisual Media
10.42
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.