Towards large-scale cross-speaker articulatory modeling of vowels

While previous studies have attempted to decompose vowel articulatory data into a set of basis factors, these studies have often been limited in both scale and the data being sparsely sampled, limiting interpretability and generalizability of the results (Nix et al. 1996 and Serrurier et al. 2019). In this study, the data were analyzed from 36 (23F, 13M) American English speakers producing 13 vowels in bVt sequences obtained using real-time MRI. Midsagittal tongue contours were obtained during vowel productions for all speakers using a semi-automated segmentation algorithm (Jain et al. 2024). Frames corresponding to the vowel articulation were segmented using MFA and simultaneously recorded audio. A combination of Procrustes analysis for cross-speaker normalization and guided PCA were employed to decompose the pooled articulatory space into a set of vowel “primitives.” 71% of the variation within the articulatory space is captured in the first three principle components, with the first component representing variation in tongue body advancement/retraction, the second component fronting/backing, and the third lesser degrees of fronting/backing. This pattern is consistent when the data is split into male/female groups. Vowel-wise PCA loadings for the first two components mostly show expected degrees of separation between the dimensions of advancement/retraction and backness, though some distinctions appear to be diluted, likely attributable to the normalization procedure. [Work supported by the NIH.]

Authors

Institutions

Publication Details

Journal
The Journal of the Acoustical Society of America
Published
2024-10-01
DOI
https://doi.org/10.1121/10.0035067
Primary Topic
Speech Recognition and Synthesis
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Towards large-scale cross-speaker articulatory modeling of vowels

Sean Foley, Shrikanth Narayanan
The Journal of the Acoustical Society of America
Speech Recognition and Synthesis
article

Towards large-scale cross-speaker articulatory modeling of vowels

Sean Foley, Shrikanth Narayanan
article en

Abstract

While previous studies have attempted to decompose vowel articulatory data into a set of basis factors, these studies have often been limited in both scale and the data being sparsely sampled, limiting interpretability and generalizability of the results (Nix et al. 1996 and Serrurier et al. 2019). In this study, the data were analyzed from 36 (23F, 13M) American English speakers producing 13 vowels in bVt sequences obtained using real-time MRI. Midsagittal tongue contours were obtained during vowel productions for all speakers using a semi-automated segmentation algorithm (Jain et al. 2024). Frames corresponding to the vowel articulation were segmented using MFA and simultaneously recorded audio. A combination of Procrustes analysis for cross-speaker normalization and guided PCA were employed to decompose the pooled articulatory space into a set of vowel “primitives.” 71% of the variation within the articulatory space is captured in the first three principle components, with the first component representing variation in tongue body advancement/retraction, the second component fronting/backing, and the third lesser degrees of fronting/backing. This pattern is consistent when the data is split into male/female groups. Vowel-wise PCA loadings for the first two components mostly show expected degrees of separation between the dimensions of advancement/retraction and backness, though some distinctions appear to be diluted, likely attributable to the normalization procedure. [Work supported by the NIH.]

The Journal of the Acoustical Society of AmericaVol. 156(4_Supplement)
University of Southern California (US)
Openalex Percentile: Top 77%
Speech Recognition and Synthesis
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.