Cross-Modal Design Systems: Translating Synesthetic Hallmarks into Multi-Sensory UI Tokens to Reduce Cognitive Load and Perceptual Error in Digital Interfaces
Contemporary digital interfaces are overwhelmingly biased toward the visual modality, demanding sustained visual attention that rapidly exhausts human working memory. While multi-modal feedback systems have been introduced to mitigate this visual fatigue, these systems frequently rely on arbitrary, non-ecological mappings between visual, auditory, and haptic cues. The arbitrary pairing of cross-modal stimuli inadvertently triggers sensory Stroop interference and exacerbates cognitive load. Under conditions of high visual demand, the Colavita visual dominance effect dictates that the human nervous system will often attenuate or completely ignore incongruent auditory and haptic feedback, so secondary sensory channels function as extraneous noise rather than meaningful data conduits. Grounded in synesthetic neuroscience and crossmodal correspondence theory, this study introduces the Synesthetic Design Token Model — mathematically rigorous, isomorphic mappings between visual properties (luminance, geometry, scale) and acoustic (frequency, envelope) and haptic (vibration frequency, sharpness) parameters. A within-subjects design (N = 30) evaluated the model across three conditions: Visual-Only, Incongruent Multi-Modal, and Congruent Synesthetic, measured via reaction time, error rate, and NASA-TLX cognitive load. The Congruent Synesthetic interface produced significantly faster reaction times and lower error rates than both other conditions. The Incongruent condition produced the highest cognitive load and slowest reaction times, confirming cross-modal Stroop interference; the Congruent condition significantly reduced mental demand, effort, and frustration. Extending W3C design tokens to biologically congruent audio-haptic values yields a measurable “diversity gain” in information processing, letting DesignOps teams mitigate the Colavita effect and build higher-throughput, more accessible interfaces.
Authors
- Ruchi Gaur Pankaj Jangir
Publication Details
- Journal
- Zenodo (CERN European Organization for Nuclear Research)
- Published
- 2026-09-15
- DOI
- https://doi.org/10.5281/zenodo.22772102
- Primary Topic
- Multisensory perception and integration
- Type
- article
- Field-Weighted Citation Impact
- 0.00