Immersive video interaction system: a survey

Abstract As communication technologies undergo rapid evolution, human interaction technologies have become increasingly efficient and accessible. Videoconferencing, for example, facilitates real-time, face-to-face communication worldwide, providing unprecedented convenience. Nevertheless, traditional two-dimensional (2D) videoconferencing systems frequently fall short of delivering a fully immersive experience, as they lack the ability to convey physical presence, depth perception, and natural interaction—key elements that are of particular significance in replicating the subtleties inherent in in-person communication. This disconnection leaves users yearning for the rich, multi-sensory experiences that real-life interactions can offer. In response, significant research efforts have been dedicated to the development of immersive video interaction systems (IVISs). This paper introduces the concept of IVISs and reviews a spectrum of systems advanced by researchers and industry innovators, each of whom contributes unique insights into the evolution of this field. A comparative analysis of the characteristics of current IVISs is provided, offering insights across multiple dimensions. This survey concludes with a discussion of potential future research directions and the challenges that remain in enhancing the IVIS technology. Through a comprehensive analysis, this work aims to foster further exploration and innovation in immersive communication technologies.