Research on the Design of a Multi-User Interactive System for Chu Music Based on Multimodal Collaboration

Purpose: Chu music, a distinctive art form from the Chu Kingdom, is defined by the integration of instrumental ensembles and coordinated dance movements. This study aims to design and develop a multi-user interactive system using multimodal collaborative technologies to enhance the synchronization between music and dance in Chu music ensembles. Method: The system constructs a multimodal dataset comprising audio, video, and motion capture data. Support Vector Machine (SVM) algorithms are utilized to classify audio features, while Mel-frequency Cepstral Coefficients (MFCCs) are employed to extract emotional characteristics of the music. Dynamic motion capture technology records detailed dance movements, and a Long Short-Term Memory (LSTM) network is applied to optimize synchronization between music and dance as well as enhance emotional expression. The system incorporates a real-time feedback mechanism to maintain precise coordination among users during ensemble performances and implements dynamic task allocation and fault-tolerance strategies to support synchronized multi-user collaboration and emotional resonance. Conclusion: The system enhances the synchronization, expressiveness, and emotional impact of Chu music group performances. It establishes a robust technological framework for traditional cultural heritage's digital preservation and dissemination, demonstrating the potential of multimodal collaborative technologies to enrich collective cultural experiences.