The more the better? Multisensory redundant mappings to convey information in abstract visualizations

Immersive technology like Virtual Reality enables the integration of multisensory stimuli in data visualizations, enhancing comprehension and decision-making, especially when the visual channel is overloaded or ambiguous. While most Immersive Analytics (IA) applications rely on visual-centric approaches, multisensory feedback remains rare, and few studies have explored non-visual senses as conventional channels for data representation. Existing work often focuses on sensory substitution rather than leveraging the potential of redundant multisensory codification. This study addresses this gap by investigating the combined use of visual, auditory, and haptic stimuli for encoding data in a simple abstract visualization. We conducted a within-subjects study (n = 52) using a 3D point-cloud visualization to evaluate how redundant codifications (node radius, pitch, and vibration intensity) influence task efficiency, accuracy, and user workload. We also studied behaviour and user experience when presented with the different combinations of stimuli. Our findings show that redundant mappings positively affect performance metrics in situations where the visual modality might be compromised. The user experiences varied, underscoring the need for tailored training and adaptation to artificial sensory codifications such as vibration. While limited to simple visualizations, this study provides insights into designing effective multisensory redundant codifications.

Authors

Institutions

Publication Details

Journal
Virtual Reality
Published
2025-11-24
DOI
https://doi.org/10.1007/s10055-025-01257-3
Primary Topic
Multisensory perception and integration
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

The more the better? Multisensory redundant mappings to convey information in abstract visualizations

Andrea Bellucci, Alejandro Rey, Ignacio Aedo, Paloma Dı́az
Virtual Reality
Multisensory perception and integration
article

The more the better? Multisensory redundant mappings to convey information in abstract visualizations

Andrea Bellucci, Alejandro Rey, Ignacio Aedo, Paloma Dı́az
article en

Abstract

Immersive technology like Virtual Reality enables the integration of multisensory stimuli in data visualizations, enhancing comprehension and decision-making, especially when the visual channel is overloaded or ambiguous. While most Immersive Analytics (IA) applications rely on visual-centric approaches, multisensory feedback remains rare, and few studies have explored non-visual senses as conventional channels for data representation. Existing work often focuses on sensory substitution rather than leveraging the potential of redundant multisensory codification. This study addresses this gap by investigating the combined use of visual, auditory, and haptic stimuli for encoding data in a simple abstract visualization. We conducted a within-subjects study (n = 52) using a 3D point-cloud visualization to evaluate how redundant codifications (node radius, pitch, and vibration intensity) influence task efficiency, accuracy, and user workload. We also studied behaviour and user experience when presented with the different combinations of stimuli. Our findings show that redundant mappings positively affect performance metrics in situations where the visual modality might be compromised. The user experiences varied, underscoring the need for tailored training and adaptation to artificial sensory codifications such as vibration. While limited to simple visualizations, this study provides insights into designing effective multisensory redundant codifications.

Virtual RealityVol. 29(4)
Universidad Carlos III de Madrid (ES)
Agencia Estatal de Investigación
Openalex Percentile: Top 62%
Multisensory perception and integration
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.