Adaptive Flexibility and Individual Stability in Audiovisual Cue Weighting under Different Listening Conditions

Phonological contrasts in speech are conveyed through multiple dimensions. Listeners may systematically adjust their cue weightings according to the context, such as under challenging listening conditions. However, individual listeners may also assign different perceptual weights to each dimension, giving rise to substantial individual differences. The present study examines how native listeners of Dutch weight an acoustic cue (fundamental frequency, f0) and two visual cues (beat gestures and lip movement) when perceiving lexical stress under different degrees of acoustic degradation induced by 16-talker babble noise. At the group level, f0 and beat gestures were robust cues to lexical stress, while the lip-movement effect was less consistent across conditions. Listeners systematically reduced their reliance on f0 as the noise became more severe, without a comparable increase in their reliance on either visual cue. At the individual level, listeners who relied more heavily on f0 in favorable listening conditions tended to show greater reductions in its absolute weighting under severe noise, with no evidence for a cross-condition trade-off between f0 and beat-gesture weighting; individual differences in relative cue weighting remained relatively stable across listening conditions. Taken together, these findings showcase both context-dependent adaptive flexibility and individual-specific stability in audiovisual cue weighting. More broadly, our findings suggest that dimension-selective attention principles may extend to cue-specific adjustments across sensory modalities under acoustic degradation. Specifically, down-weighting of a degraded acoustic cue does not necessarily entail compensatory up-weighting of visual cues, even though they remain physically intact.

Authors

Publication Details

Journal
PsyArXiv (OSF Preprints)
Published
2026-11-17
DOI
https://doi.org/10.31234/osf.io/sdbxe
Primary Topic
Phonetics and Phonology Research
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
preprint

Adaptive Flexibility and Individual Stability in Audiovisual Cue Weighting under Different Listening Conditions

Hans Rutger Bosker, Chengjia Ye, James M. McQueen
2 links
PsyArXiv (OSF Preprints)
Phonetics and Phonology Research
preprint

Adaptive Flexibility and Individual Stability in Audiovisual Cue Weighting under Different Listening Conditions

Hans Rutger Bosker, Chengjia Ye, James M. McQueen
preprint en

Abstract

Phonological contrasts in speech are conveyed through multiple dimensions. Listeners may systematically adjust their cue weightings according to the context, such as under challenging listening conditions. However, individual listeners may also assign different perceptual weights to each dimension, giving rise to substantial individual differences. The present study examines how native listeners of Dutch weight an acoustic cue (fundamental frequency, f0) and two visual cues (beat gestures and lip movement) when perceiving lexical stress under different degrees of acoustic degradation induced by 16-talker babble noise. At the group level, f0 and beat gestures were robust cues to lexical stress, while the lip-movement effect was less consistent across conditions. Listeners systematically reduced their reliance on f0 as the noise became more severe, without a comparable increase in their reliance on either visual cue. At the individual level, listeners who relied more heavily on f0 in favorable listening conditions tended to show greater reductions in its absolute weighting under severe noise, with no evidence for a cross-condition trade-off between f0 and beat-gesture weighting; individual differences in relative cue weighting remained relatively stable across listening conditions. Taken together, these findings showcase both context-dependent adaptive flexibility and individual-specific stability in audiovisual cue weighting. More broadly, our findings suggest that dimension-selective attention principles may extend to cue-specific adjustments across sensory modalities under acoustic degradation. Specifically, down-weighting of a degraded acoustic cue does not necessarily entail compensatory up-weighting of visual cues, even though they remain physically intact.

PsyArXiv (OSF Preprints)
Phonetics and Phonology Research
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon