Generating Haptic Motion Effects for General Scenes to Improve 4D Experiences

Motion effects are vital for enhancing 4D experiences in various applications, e.g., rides, films, and games, by physically moving the user. Recent research introduced algorithms for generating effective motion effects from the audiovisual stream, but these approaches either require object motion trajectories or miss important scene components, such as other objects, particles, and camera motion. This paper proposes a fully automatic algorithm synthesizing motion effects from all scene components. Our method leverages computer vision technologies to capture salient movements among multiple components, enabling the creation of holistic motion effects without the need for human intervention. Then, our method computes a motion proxy representing the movements of the scene components by compressing the captured movements into a singlepoint motion. The motion proxy is converted into a motion command through a motion cueing algorithm and delivered to the user. The results of a user study show that our algorithm can generate compelling motion effects that enhance the 4D experience better than semi-manually authored effects. Our approach can facilitate the production of captivating motion effects for many applications.