Expectation of speech style improves audio-visual perception of English vowels

• Prior knowledge of speech style improved accuracy in identifying style and words. • Congruent style prompts improve accuracy by aligning with high-level expectations. • Clear speech enhances identification accuracy due to signal-internal modifications. • High-level information (such as speech style) is embodied in the signal. Speech perception is influenced by both signal-internal properties and signal-independent knowledge, including communicative expectations. This study investigates how these two factors interact, focusing on the role of speech style expectations. Specifically, we examine how prior knowledge about speech style (clear versus plain speech) affects word identification and speech style judgment. Native English perceivers were presented with English words containing tense versus lax vowels in either clear or plain speech, with trial conditions manipulating whether style prompts (presented immediately prior to the target word) were congruent or incongruent with the actual speech style. The stimuli were also presented in three input modalities: auditory (speaker voice), visual (speaker face), and audio-visual. Results show that prior knowledge of speech style improved accuracy in identifying style after the session when style information in the prompt and target word was consistent, particularly in auditory and audio-visual modalities. Additionally, as expected, clear speech enhanced word intelligibility compared to plain speech, with benefits more evident for tense vowels and in auditory and audio-visual contexts. These results demonstrate that congruent style prompts improve style identification accuracy by aligning with high-level expectations, while clear speech enhances word identification accuracy due to signal-internal modifications. Overall, the current findings suggest an interplay of processing sources of information which are both signal-driven and signal-independent, and that high-level signal-complementary information such as speech style is not separate from, but is embodied in, the signal.

Authors

Institutions

Publication Details

Journal
Speech Communication
Published
2025-04-17
DOI
https://doi.org/10.1016/j.specom.2025.103243
Citations
2
Primary Topic
Phonetics and Phonology Research
Type
article
Field-Weighted Citation Impact
4.24
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Expectation of speech style improves audio-visual perception of English vowels

Haoyao Ruan, Yue Wang, Allard Jongman, Jetic Gū et al.
2 citations
Speech Communication
Phonetics and Phonology Research
4.24
article

Expectation of speech style improves audio-visual perception of English vowels

Haoyao Ruan, Yue Wang, Allard Jongman, Jetic Gū, Dawn M. Behne, Paul Tupper, Joan A. Sereno
article en
2 citations

Abstract

• Prior knowledge of speech style improved accuracy in identifying style and words. • Congruent style prompts improve accuracy by aligning with high-level expectations. • Clear speech enhances identification accuracy due to signal-internal modifications. • High-level information (such as speech style) is embodied in the signal. Speech perception is influenced by both signal-internal properties and signal-independent knowledge, including communicative expectations. This study investigates how these two factors interact, focusing on the role of speech style expectations. Specifically, we examine how prior knowledge about speech style (clear versus plain speech) affects word identification and speech style judgment. Native English perceivers were presented with English words containing tense versus lax vowels in either clear or plain speech, with trial conditions manipulating whether style prompts (presented immediately prior to the target word) were congruent or incongruent with the actual speech style. The stimuli were also presented in three input modalities: auditory (speaker voice), visual (speaker face), and audio-visual. Results show that prior knowledge of speech style improved accuracy in identifying style after the session when style information in the prompt and target word was consistent, particularly in auditory and audio-visual modalities. Additionally, as expected, clear speech enhanced word intelligibility compared to plain speech, with benefits more evident for tense vowels and in auditory and audio-visual contexts. These results demonstrate that congruent style prompts improve style identification accuracy by aligning with high-level expectations, while clear speech enhances word identification accuracy due to signal-internal modifications. Overall, the current findings suggest an interplay of processing sources of information which are both signal-driven and signal-independent, and that high-level signal-complementary information such as speech style is not separate from, but is embodied in, the signal.

Speech CommunicationVol. 171
University of Kansas (US), Simon Fraser University (CA), Norwegian University of Science and Technology (NO)
Quality Education
Openalex Percentile: Top 7%
Phonetics and Phonology Research
4.24
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.