Does Audio Make Mixed Reality Dark? Audio Dark Patterns, Detection, and Futures in Virtual–Physical Commerce

The metaverse transforms multimedia engagement, altering user perception in blended virtual-physical environments. In these immersive spaces, deceptive designs using audiovisual cues to manipulate user choices can be highly successful. This article explores the design space of manipulative techniques, known as dark patterns (DPs), specifically within metaverse e-commerce applications. We evaluate user interactions with manipulative designs through two exploratory mixed reality studies, revealing how audio DPs effectively manipulate users' attention, surroundings, and perceptions. To combat this, we implement a prototypical detection model for malicious audio cues. Preliminary results demonstrate that users are highly vulnerable to audio DPs, with a 40% susceptibility rate, highlighting the urgent need for detection models (which achieved an F1-score of 0.74). Following a survey on counteracting manipulative e-commerce scenarios, our study's findings reinforce the clear need for robust design guidelines to mitigate audio-enabled DPs in mixed reality and to improve overall user awareness.

Authors

Institutions

Publication Details

Journal
International Journal of Human-Computer Interaction
Published
2026-06-18
DOI
https://doi.org/10.1080/10447318.2026.2674834
Primary Topic
Virtual Reality Applications and Impacts
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Does Audio Make Mixed Reality Dark? Audio Dark Patterns, Detection, and Futures in Virtual–Physical Commerce

Esmée Henrieke Anne de Haas, Carlos Bermejo, H Pan, Lik-Hang Lee et al.
International Journal of Human-Computer Interaction
Virtual Reality Applications and Impacts
article

Does Audio Make Mixed Reality Dark? Audio Dark Patterns, Detection, and Futures in Virtual–Physical Commerce

Esmée Henrieke Anne de Haas, Carlos Bermejo, H Pan, Lik-Hang Lee, Zijun Lin, Yiming Huang
article en

Abstract

The metaverse transforms multimedia engagement, altering user perception in blended virtual-physical environments. In these immersive spaces, deceptive designs using audiovisual cues to manipulate user choices can be highly successful. This article explores the design space of manipulative techniques, known as dark patterns (DPs), specifically within metaverse e-commerce applications. We evaluate user interactions with manipulative designs through two exploratory mixed reality studies, revealing how audio DPs effectively manipulate users' attention, surroundings, and perceptions. To combat this, we implement a prototypical detection model for malicious audio cues. Preliminary results demonstrate that users are highly vulnerable to audio DPs, with a 40% susceptibility rate, highlighting the urgent need for detection models (which achieved an F1-score of 0.74). Following a survey on counteracting manipulative e-commerce scenarios, our study's findings reinforce the clear need for robust design guidelines to mitigate audio-enabled DPs in mixed reality and to improve overall user awareness.

International Journal of Human-Computer Interaction
Hong Kong Polytechnic University (HK), Chinese University of Hong Kong (HK), Hong Kong University of Science and Technology (HK), University of Hong Kong (HK), London School of Economics and Political Science (GB)
Openalex Percentile: Top 5%
Virtual Reality Applications and Impacts
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.