Uncovering between-categorical details in L2 pronunciation errors using Wav2Vec2.0 code vectors*

L2 pronunciation errors, influenced by L1 phonetic transfer, often span the boundaries of two or more canonical phonemes. This phenomenon necessitates moving beyond the categorical judgments by analyzing pronunciation using units more granular than phonemes. While previous studies proposed phonemic posterior-grams (PPG) in this context, these features remain tied to a categorical framework when derived through phonemic association. This study employs Wav2Vec2.0 code vectors as an alternative description unit, granted that the self-supervised learning (SSL) representation is free from external phonemic stipulation. We first evaluate whether code vectors encode L1 and L2 speech differently and use them to identify patterns among categorically identical error samples. To this end, the used inventory in single-speaker data of L1 (CMU ARCTIC) and L2 (L2 ARCTIC) is first compared. Then, substitution errors are selected from our L2 analysis NIA037 data using the model finetuned with TIMIT. For each error type, sub-categorical inspection concerns deriving dominant patterns from corresponding featural sequences and interpreting them using raw code vector clustering results and phoneme-code vector co-occurrence probabilities, both constructed from the L1 reference data TIMIT. The findings revealed that, beyond discerning L2 speech, code vectors can effectively quantify the between-categorical positions of error patterns in the pronunciation spectrum. Specifically, Euclidean distances between pattern vectors reflected phonetically grounded variation phenomena documented in existing L2 literature.

Authors

Publication Details

Journal
Phonetics and Speech Sciences
Published
2024-12-01
DOI
https://doi.org/10.13064/ksss.2024.16.4.073
Primary Topic
Speech Recognition and Synthesis
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Uncovering between-categorical details in L2 pronunciation errors using Wav2Vec2.0 code vectors*

Sunhee Kim, Minhwa Chung, Eunsoo Hong
Phonetics and Speech Sciences
Speech Recognition and Synthesis
article

Uncovering between-categorical details in L2 pronunciation errors using Wav2Vec2.0 code vectors*

Sunhee Kim, Minhwa Chung, Eunsoo Hong
article en

Abstract

L2 pronunciation errors, influenced by L1 phonetic transfer, often span the boundaries of two or more canonical phonemes. This phenomenon necessitates moving beyond the categorical judgments by analyzing pronunciation using units more granular than phonemes. While previous studies proposed phonemic posterior-grams (PPG) in this context, these features remain tied to a categorical framework when derived through phonemic association. This study employs Wav2Vec2.0 code vectors as an alternative description unit, granted that the self-supervised learning (SSL) representation is free from external phonemic stipulation. We first evaluate whether code vectors encode L1 and L2 speech differently and use them to identify patterns among categorically identical error samples. To this end, the used inventory in single-speaker data of L1 (CMU ARCTIC) and L2 (L2 ARCTIC) is first compared. Then, substitution errors are selected from our L2 analysis NIA037 data using the model finetuned with TIMIT. For each error type, sub-categorical inspection concerns deriving dominant patterns from corresponding featural sequences and interpreting them using raw code vector clustering results and phoneme-code vector co-occurrence probabilities, both constructed from the L1 reference data TIMIT. The findings revealed that, beyond discerning L2 speech, code vectors can effectively quantify the between-categorical positions of error patterns in the pronunciation spectrum. Specifically, Euclidean distances between pattern vectors reflected phonetically grounded variation phenomena documented in existing L2 literature.

Phonetics and Speech SciencesVol. 16(4)
Quality Education
Openalex Percentile: Top 76%
Speech Recognition and Synthesis
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Uncovering between-categorical details in L2 pronunciation errors using Wav2Vec2.0 code vectors* — Sunhee Kim, Minhwa Chung, et al. · Phonetics and Speech Sciences (2024) | TGRS Research Map | TGRS