From 2D to 3D: Redesigning the Desktop Metaphor in Virtual Reality

Since the 1980s, many scholars have argued that future interfaces will evolve into Natural User Interfaces (NUI) centered on human abilities such as the five senses, expression, motion, and cognition [6], [7]. Because NUI interfaces stem from the essence of humanity, they require a 3D environment similar to the real world in which humans live. Fortunately, VR HMD devices not only provide such a 3D environment but also enable hand gestures and multi-modal I/O through camera tracking technology, making it possible to replicate physical laws akin to reality within a virtual space. This offers an environment that is well-suited for implementing NUI interfaces.