HandWind-Sim: Real-time-web-based cloth simulation with gesture-driven wind interaction

This paper presents HandWind-Sim , a web-based open-source framework that tracks hand gestures via a standard webcam and MediaPipe, converts them into intuitive wind vectors, and applies these vectors to a position-based dynamics (PBD) cloth simulation. With a simple hand movement, the system realistically simulates fluttering cloth as if blown by actual wind in real time. HandWind-Sim enables complex physics-based interactions without the need for specialized hardware, offering high accessibility to researchers and developers in fields such as HCI, virtual prototyping, and interactive art.