Optical motion capture application based on Unity3D and MediaPipe

With the rapid development of computer software and hardware technology and the increasing requirements for animation production,motion capture and motion capture have entered a practical stage. In recent years, more and more games use motion capture to complete the animation of the game. The mainstream optical motion capture technology has high capture accuracy and frame rate,but it is expensive and requires a large number of complex hardware devices and strict studio environment. Another dynamic capture technology, inertial dynamic capture technology requires the use of inertial measurement unit including gyroscopes, accelerometers, magnetometers and other sensors to measure the motion information of human bones. The number of IMUs for an inertial motion capture device usually ranges from a few to a dozen. How to use simple hardware devices to promote motion capture to general game developers and quickly complete the upstream and downstream wor of motion capture is the goal of this paper.