Exploring Emotion Expression Through Silent Speech Interface in Public VR/MR: Effects of Automation on User Experience

Silent speech input offers a secure and private alternative to voice input in public spaces.As HMDs become increasingly mobile, the need for integrating silent speech recognition grows to enable seamless interaction in public settings.However, the potential of silent speech-based emotion recognition in VR/MR environments remains underexplored, despite the importance of emotional expression in social interactions.This paper evaluates how different levels of automation in emotional expression-Manual, Semi-auto, and Automatic-affect user experience in VR environments.The results revealed that Semi-auto methods generally offer better efficiency, user control, and socially acceptable interactions.