MemeSpeak: Making Image Memes Blind-Accessible through Emotional Speech Augmentation

Image memes—combining humorous or satirical pictures with overlaying text—are a powerful medium for emotional expression. However, their visual nature makes them largely inaccessible to blind and low vision (BLV) users. We present MemeSpeak, a system that generates emotionally expressive audio narrations of memes through emotional speech augmentation. We developed two emotion-conveying strategies: emotion-only and character-plus-emotion, and evaluated them against standard screen-reader-based descriptions with 12 BLV participants. Results showed that both strategies significantly improved emotional resonance, eliciting stronger emotional fluctuations and better understanding of the sender’s intent. Qualitative feedback revealed that the character-plus-emotion strategy enhanced immersion and clarity, particularly for complex or multi-character memes. We further highlight implications for conveying visual humor in blind-accessible formats.

Institutions

Publication Details

Published
2025-10-17
DOI
https://doi.org/10.1145/3715070.3749267
Primary Topic
Speech and Audio Processing
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

MemeSpeak: Making Image Memes Blind-Accessible through Emotional Speech Augmentation

Speech and Audio Processing
article

MemeSpeak: Making Image Memes Blind-Accessible through Emotional Speech Augmentation

article en

Abstract

Image memes—combining humorous or satirical pictures with overlaying text—are a powerful medium for emotional expression. However, their visual nature makes them largely inaccessible to blind and low vision (BLV) users. We present MemeSpeak, a system that generates emotionally expressive audio narrations of memes through emotional speech augmentation. We developed two emotion-conveying strategies: emotion-only and character-plus-emotion, and evaluated them against standard screen-reader-based descriptions with 12 BLV participants. Results showed that both strategies significantly improved emotional resonance, eliciting stronger emotional fluctuations and better understanding of the sender’s intent. Qualitative feedback revealed that the character-plus-emotion strategy enhanced immersion and clarity, particularly for complex or multi-character memes. We further highlight implications for conveying visual humor in blind-accessible formats.

Tongji University (CN), Hong Kong University of Science and Technology (HK)
Openalex Percentile: Top 42%
Speech and Audio Processing
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.