The McGurk effect is similar in native Mandarin Chinese and American English speakers

Humans combine the visual information from mouth movements with auditory information from the voice to recognize speech. A common method for assessing audiovisual speech perception is the McGurk effect: when presented with some incongruent pairings of auditory and visual speech syllables (e.g., the auditory speech sound "ba" dubbed onto the visual mouth movements for "ga") individuals perceive a third syllable, distinct from the auditory and visual components. The many differences between Chinese and American culture and language suggest the possibility of group differences in the McGurk effect. Published studies have reported less McGurk effect in native Mandarin Chinese speakers than in English speakers, but these studies sampled small numbers of participants tested with a small number of stimuli. Therefore, we conducted in-person tests of the McGurk effect in large samples of Mandarin-speaking individuals from China and English-speaking individuals from the USA (total <i>N</i> = 307) viewing nine different stimuli. Averaged across participants and stimuli, we found similar frequencies of the McGurk effect between Chinese and American participants (48% vs. 44%). In both groups, there was high variability both across participants (range from 0% to 100%) and stimuli (14%-83%) with the main effect of culture and language accounting for only 0.2% of the variance in the data. The high variability inherent to the McGurk effect necessitates the use of large sample sizes to accurately estimate group differences and requires testing with a variety of McGurk stimuli, especially stimuli potent enough to evoke the illusion in the majority of participants.

Authors

Institutions

Publication Details

Journal
Frontiers in Psychology
Published
2025-03-28
DOI
https://doi.org/10.3389/fpsyg.2025.1531566
Citations
3
Primary Topic
Multisensory perception and integration
Type
article
Field-Weighted Citation Impact
6.35

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

The McGurk effect is similar in native Mandarin Chinese and American English speakers

John F. Magnotti, Wen Zhou, Bin Zhou, Debshila Basu Mallick et al.
3 citations
Frontiers in Psychology
Multisensory perception and integration
6.35
article

The McGurk effect is similar in native Mandarin Chinese and American English speakers

John F. Magnotti, Wen Zhou, Bin Zhou, Debshila Basu Mallick, Michael S. Beauchamp, Guo Feng
article en
3 citations

Abstract

Humans combine the visual information from mouth movements with auditory information from the voice to recognize speech. A common method for assessing audiovisual speech perception is the McGurk effect: when presented with some incongruent pairings of auditory and visual speech syllables (e.g., the auditory speech sound "ba" dubbed onto the visual mouth movements for "ga") individuals perceive a third syllable, distinct from the auditory and visual components. The many differences between Chinese and American culture and language suggest the possibility of group differences in the McGurk effect. Published studies have reported less McGurk effect in native Mandarin Chinese speakers than in English speakers, but these studies sampled small numbers of participants tested with a small number of stimuli. Therefore, we conducted in-person tests of the McGurk effect in large samples of Mandarin-speaking individuals from China and English-speaking individuals from the USA (total <i>N</i> = 307) viewing nine different stimuli. Averaged across participants and stimuli, we found similar frequencies of the McGurk effect between Chinese and American participants (48% vs. 44%). In both groups, there was high variability both across participants (range from 0% to 100%) and stimuli (14%-83%) with the main effect of culture and language accounting for only 0.2% of the variance in the data. The high variability inherent to the McGurk effect necessitates the use of large sample sizes to accurately estimate group differences and requires testing with a variety of McGurk stimuli, especially stimuli potent enough to evoke the illusion in the majority of participants.

Frontiers in PsychologyVol. 16
Institute of Psychology, Chinese Academy of Sciences (CN), Southwest Jiaotong University (CN), Rice University (US), University of Pennsylvania (US)
National Institutes of Health
Openalex Percentile: Top 4%
Multisensory perception and integration
6.35
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.