Japanese Vowel-mora Visualization for Dysarthria Rehabilitation with Variational Autoencoder

This work proposes a Variational AutoEncoder (VAE)-based rehabilitation framework that visualizes the vowel-mora for Japanese dysarthria. Traditionally, Speech-Language Pathology (SLP) has shown the guideline of rehabilitation for dysarthria, but they should rely only on clinical experience and case-by-case adaption, highlighting the urgent necessity to push the boundary for showing a subjective guideline, which does not depend on the perspective of SLPs. The proposed framework takes advantage of two-dimensional latent representations of vowel-mora, which is assumed to be pre-processed by mel-spectrogram, via VAE. The experiments highlight the effectiveness of our proposed framework.