Optical Flow-Based Anticipatory Audio Cues for Cybersickness Mitigation in Passive Navigation VR Environments

Virtual reality (VR) applications face a critical trade-off: while visual immersion is the core experience, it often induces cybersickness (CS), leading to user attrition. Existing visual interventions (e.g., field-of-view restriction) alleviate discomfort at the cost of compromising immersion. Auditory interventions have been widely applied in mitigating motion sickness (MS), such as through music interventions and synchronized sound effects. Among all MS mitigation approaches, anticipatory audio cues have demonstrated effectiveness in vehicular MS contexts, reducing symptoms by approximately 17%. However, questions remain regarding VR cybersickness (CS): Do anticipatory audio cues remain effective in highly immersive virtual environments, where the dominance of visual interaction in VR may alter cue perception compared to that in MS contexts? How can VR motion intensity information be encoded, given that such information is largely absent in current mitigation strategies? How can anticipatory audio cues be systematically designed for CS mitigation through explicit mapping frameworks that link visual motion parameters to audio features? To address these gaps, this study establishes an optical flow mapping framework that encodes motion direction through stereo positioning and intensity through temporal patterns, delivering the results 2 seconds in advance. A within-subjects experiment (N = 24) was conducted in VR roller coaster environments, in which four conditions were compared. Results demonstrated a significant reduction in cybersickness across all audio conditions (direction-only: d = 0.862; intensity-only: d = 0.670; combined: d = 1.497, p <.001), with combined cues outperforming single-dimension alternatives (p <.016). All interventions preserved visual immersion (M ≈ 4.0/5) and maintained high usability metrics. This framework demonstrates that non-visual predictive cues can address the immersion-comfort trade-off in VR applications.

Authors

Institutions

Publication Details

Journal
Proceedings of the ACM on Computer Graphics and Interactive Techniques
Published
2026-05-01
DOI
https://doi.org/10.1145/3804502
Primary Topic
Virtual Reality Applications and Impacts
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Optical Flow-Based Anticipatory Audio Cues for Cybersickness Mitigation in Passive Navigation VR Environments

Yuxue Bao, Elliott Wen, Burkhard Claus Wünsche, Xin Wang
Proceedings of the ACM on Computer Graphics and Interactive Techniques
Virtual Reality Applications and Impacts
article

Optical Flow-Based Anticipatory Audio Cues for Cybersickness Mitigation in Passive Navigation VR Environments

Yuxue Bao, Elliott Wen, Burkhard Claus Wünsche, Xin Wang
article en

Abstract

Virtual reality (VR) applications face a critical trade-off: while visual immersion is the core experience, it often induces cybersickness (CS), leading to user attrition. Existing visual interventions (e.g., field-of-view restriction) alleviate discomfort at the cost of compromising immersion. Auditory interventions have been widely applied in mitigating motion sickness (MS), such as through music interventions and synchronized sound effects. Among all MS mitigation approaches, anticipatory audio cues have demonstrated effectiveness in vehicular MS contexts, reducing symptoms by approximately 17%. However, questions remain regarding VR cybersickness (CS): Do anticipatory audio cues remain effective in highly immersive virtual environments, where the dominance of visual interaction in VR may alter cue perception compared to that in MS contexts? How can VR motion intensity information be encoded, given that such information is largely absent in current mitigation strategies? How can anticipatory audio cues be systematically designed for CS mitigation through explicit mapping frameworks that link visual motion parameters to audio features? To address these gaps, this study establishes an optical flow mapping framework that encodes motion direction through stereo positioning and intensity through temporal patterns, delivering the results 2 seconds in advance. A within-subjects experiment (N = 24) was conducted in VR roller coaster environments, in which four conditions were compared. Results demonstrated a significant reduction in cybersickness across all audio conditions (direction-only: d = 0.862; intensity-only: d = 0.670; combined: d = 1.497, p <.001), with combined cues outperforming single-dimension alternatives (p <.016). All interventions preserved visual immersion (M ≈ 4.0/5) and maintained high usability metrics. This framework demonstrates that non-visual predictive cues can address the immersion-comfort trade-off in VR applications.

Proceedings of the ACM on Computer Graphics and Interactive TechniquesVol. 9(1)
University of Auckland (NZ)
Life below water
Openalex Percentile: Top 7%
Virtual Reality Applications and Impacts
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.