Cross-Modal Design Systems: Translating Synesthetic Hallmarks into Multi-Sensory UI Tokens to Reduce Cognitive Load and Perceptual Error in Digital Interfaces

Contemporary digital interfaces are overwhelmingly biased toward the visual modality, demanding sustained visual attention that rapidly exhausts human working memory. While multi-modal feedback systems have been introduced to mitigate this visual fatigue, these systems frequently rely on arbitrary, non-ecological mappings between visual, auditory, and haptic cues. The arbitrary pairing of cross-modal stimuli inadvertently triggers sensory Stroop interference and exacerbates cognitive load. Under conditions of high visual demand, the Colavita visual dominance effect dictates that the human nervous system will often attenuate or completely ignore incongruent auditory and haptic feedback, so secondary sensory channels function as extraneous noise rather than meaningful data conduits. Grounded in synesthetic neuroscience and crossmodal correspondence theory, this study introduces the Synesthetic Design Token Model — mathematically rigorous, isomorphic mappings between visual properties (luminance, geometry, scale) and acoustic (frequency, envelope) and haptic (vibration frequency, sharpness) parameters. A within-subjects design (N = 30) evaluated the model across three conditions: Visual-Only, Incongruent Multi-Modal, and Congruent Synesthetic, measured via reaction time, error rate, and NASA-TLX cognitive load. The Congruent Synesthetic interface produced significantly faster reaction times and lower error rates than both other conditions. The Incongruent condition produced the highest cognitive load and slowest reaction times, confirming cross-modal Stroop interference; the Congruent condition significantly reduced mental demand, effort, and frustration. Extending W3C design tokens to biologically congruent audio-haptic values yields a measurable “diversity gain” in information processing, letting DesignOps teams mitigate the Colavita effect and build higher-throughput, more accessible interfaces.

Authors

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-09-15
DOI
https://doi.org/10.5281/zenodo.22772102
Primary Topic
Multisensory perception and integration
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
article

Cross-Modal Design Systems: Translating Synesthetic Hallmarks into Multi-Sensory UI Tokens to Reduce Cognitive Load and Perceptual Error in Digital Interfaces

Ruchi Gaur Pankaj Jangir
Zenodo (CERN European Organization for Nuclear Research)
Multisensory perception and integration
article

Cross-Modal Design Systems: Translating Synesthetic Hallmarks into Multi-Sensory UI Tokens to Reduce Cognitive Load and Perceptual Error in Digital Interfaces

Ruchi Gaur Pankaj Jangir
article en

Abstract

Contemporary digital interfaces are overwhelmingly biased toward the visual modality, demanding sustained visual attention that rapidly exhausts human working memory. While multi-modal feedback systems have been introduced to mitigate this visual fatigue, these systems frequently rely on arbitrary, non-ecological mappings between visual, auditory, and haptic cues. The arbitrary pairing of cross-modal stimuli inadvertently triggers sensory Stroop interference and exacerbates cognitive load. Under conditions of high visual demand, the Colavita visual dominance effect dictates that the human nervous system will often attenuate or completely ignore incongruent auditory and haptic feedback, so secondary sensory channels function as extraneous noise rather than meaningful data conduits. Grounded in synesthetic neuroscience and crossmodal correspondence theory, this study introduces the Synesthetic Design Token Model — mathematically rigorous, isomorphic mappings between visual properties (luminance, geometry, scale) and acoustic (frequency, envelope) and haptic (vibration frequency, sharpness) parameters. A within-subjects design (N = 30) evaluated the model across three conditions: Visual-Only, Incongruent Multi-Modal, and Congruent Synesthetic, measured via reaction time, error rate, and NASA-TLX cognitive load. The Congruent Synesthetic interface produced significantly faster reaction times and lower error rates than both other conditions. The Incongruent condition produced the highest cognitive load and slowest reaction times, confirming cross-modal Stroop interference; the Congruent condition significantly reduced mental demand, effort, and frustration. Extending W3C design tokens to biologically congruent audio-haptic values yields a measurable “diversity gain” in information processing, letting DesignOps teams mitigate the Colavita effect and build higher-throughput, more accessible interfaces.

Zenodo (CERN European Organization for Nuclear Research)
Decent work and economic growth
Openalex Percentile: Top 7%
Multisensory perception and integration
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Cross-Modal Design Systems: Translating Synesthetic Hallmarks into Multi-Sensory UI Tokens to Reduce Cognitive Load and Perceptual Error in Digital Interfaces — Ruchi Gaur Pankaj Jangir · Zenodo (CERN European Organization for Nuclear Research) (2026) | TGRS Research Map | TGRS