Progressive Speech-Driven VR: Merging technical innovation with artistic explorations of identity

<p xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" class="first" dir="auto" id="d4043734e66">This paper introduces a progressive speech-driven virtual reality (VR) interaction model that enhances user engagement and accessibility. Traditional VR interactions, often reliant on hand controllers, can limit user immersion and accessibility. Our proposed model utilizes partial speech recognition to incrementally unlock VR functions as users speak predefined or context-relevant sentences, contrasting with conventional single-command voice interactions. This approach is demonstrated in the immersive artwork "Unseen Claimed," where voice-based interactions replace hand controllers, allowing participants to engage with the system by speaking identity-related manifestos. These manifestos sequentially reveal and ultimately dissolve virtual representations of the self, encouraging participants to confront unfamiliar reflections and disappearing virtual personas. The artwork combines real-world acts of self-definition with conceptual investigations into notions of non-identity, promoting inclusivity and offering a reflective framework for examining the boundaries of selfhood within digitally mediated environments. Preliminary testing indicates that this speech-driven interface offers more intuitive interactions, reduces physical exertion, and enhances the sense of presence compared to traditional controller-based VR systems. The progressive speech recognition system provides continuous feedback, reducing cognitive load and fostering a deeper connection to the virtual experience. This research highlights the potential for voice-centred systems to enhance not only user experience and inclusivity but also conceptual explorations of virtual identity in VR contexts.