Mouthing in comprehension of multimodal multilingual units in Norwegian Sign Language

Mouthings -- mouth movements that mimic spoken language words produced alongside signing -- are a unique multimodal phenomenon in that they recruit resources from a second language; however, they have not received much attention in research that explicitly frames itself as multimodal. In Norwegian Sign Language (NSL/NTS), the role of mouthing in comprehension has not been studied extensively from the perspective of deaf users of the language. In this study, we add to these two understudied areas by exploring mouthings in comprehension of Norwegian Sign Language in an unrestricted lexical identification paradigm (N=30). We find that when manual forms are polysemous, plausible mouthings improve accuracy in lexical identification and the certainty of comprehension. When mouthings are implausible, it appears that the dominant strategy is to make identification decisions based on the manual form only. In a smaller number of cases participants appeared to rely solely on the mouthing or blended the mouthing and manual components.

Authors

Publication Details

Published
2026-10-30
DOI
https://doi.org/10.31234/osf.io/ct9ew_v1
Primary Topic
Hearing Impairment and Communication
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
preprint

Mouthing in comprehension of multimodal multilingual units in Norwegian Sign Language

Felicia Bisnath, Benjamin Anible, Maren Sørhaug
1 links
Hearing Impairment and Communication
preprint

Mouthing in comprehension of multimodal multilingual units in Norwegian Sign Language

Felicia Bisnath, Benjamin Anible, Maren Sørhaug
preprint en

Abstract

Mouthings -- mouth movements that mimic spoken language words produced alongside signing -- are a unique multimodal phenomenon in that they recruit resources from a second language; however, they have not received much attention in research that explicitly frames itself as multimodal. In Norwegian Sign Language (NSL/NTS), the role of mouthing in comprehension has not been studied extensively from the perspective of deaf users of the language. In this study, we add to these two understudied areas by exploring mouthings in comprehension of Norwegian Sign Language in an unrestricted lexical identification paradigm (N=30). We find that when manual forms are polysemous, plausible mouthings improve accuracy in lexical identification and the certainty of comprehension. When mouthings are implausible, it appears that the dominant strategy is to make identification decisions based on the manual form only. In a smaller number of cases participants appeared to rely solely on the mouthing or blended the mouthing and manual components.

Hearing Impairment and Communication
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon