Applying cross-modal plasticity principles in auditory training applications

Research indicates that a significant number of individuals are in a suboptimal auditory health state, yet their auditory function can potentially be improved through auditory training. To raise awareness of auditory health issues, auditory training apps should provide effective yet accessible training methods alongside engaging mechanisms that motivate users to adopt and sustain auditory training habits, ultimately facilitating self-directed auditory health management. Current auditory training apps overlook the importance of user needs and motivation, as well as the relationship between the two, leading to low engagement and retention rates. We document the specific needs of both normal-hearing and mildly hearing-impaired users and analyze physiological data collected during auditory training tasks. Through lab experiment study, we provide quantitative evidence supporting the effectiveness of the auditory training method used in this study. The findings indicate that audiovisual-based auditory training contributes to improved auditory performance. Building on these insights, we develop an auditory training app prototype that integrates gamification and narrative design into the auditory training app prototype, and examine their impact on user motivation and engagement. Furthermore, based on the results, we propose design recommendations for future auditory training app development, emphasizing the need to align training effectiveness with user motivation and engagement strategies. • Auditory training apps should support all levels of auditory ability. • Focus on effective training using cross-modal plasticity methods. • Audiovisual training can ease cognitive load in auditory tasks. • Enhance engagement, motivation, and usability to build trust.