Design and Implementation of Multi-mode Natural Interaction of Game Animation Characters in Mixed Reality: A Novel User Experience Method

To enhance users’ novel experiences in gaming, the design method of multi-mode natural interaction of game animation characters in mixed reality is studied. Through the process of skeleton modeling, interpolation of position and orientation, time alignment and time transformation of character posture, the game animation character in mixed reality is constructed. The multi-role interactive game animation is synthesized using a random graph and uniform network, and the edge of the depth of field image collected by the Kinect somatosensory sensor is extracted. According to the transfer model and observation model of the Kalman filter algorithm, the motion trajectory of the game animation characters is obtained and the game animation characters are tracked. The IRS recognition algorithm is used for optical multi-touch processing in mixed reality, and the natural interaction of multi-mode game animation characters in interaction–perception mode, natural interaction mode and interactive feedback mode is realized. The experimental results demonstrate that this method can achieve multi-mode natural interaction of game animation characters in mixed reality and provide users with a novel game experience.