Framework for adaptive multimodal serious games for early intervention of autistic children

Autism spectrum disorder (ASD) is a pervasive developmental disorder characterized by difficulties in social communication and restricted, repetitive behaviors. Early intervention is essential to improve developmental outcomes in children with ASD. Serious games, which combine educational objectives with game-based interactions, have shown potential as tools for early intervention in patients with ASD. However, in China, the development of serious games specifically designed for children with ASD remains in its infancy, with significant gaps in technical frameworks and effective data management methods. This paper proposes a framework aimed at facilitating the development of multimodal serious games designed for ASD interventions. We demonstrated the feasibility of the framework by developing and integrating several components, such as web applications, mobile games, and augmented reality games. These tools are interconnected to achieve data connectivity and management. Additionally, adaptive mechanics were employed within the framework to analyze real-time player data, which allowed the game difficulty to be dynamically adjusted and provide a personalized experience for each child. Results The framework successfully integrated various multimodal games, ensuring that real-time data management supported personalized game experiences. This approach ensured that the interventions remained appropriately challenging while still achievable. The results indicate that the proposed framework enhances collaboration among therapists, parents, and developers while also improving the effectiveness of ASD interventions. By delivering personalized gameplay experiences that are both challenging and achievable, the framework offers a scalable platform for the future development of serious games.