Tone in Perspective: A Computational Typological Analysis of Tone Function in ASR

This study investigates the impact of pitch flattening on automatic speech recognition (ASR) performance across tonal and non-tonal languages.Using vocoder-based signal processing techniques, we created pitch-flattened versions of speech recordings and compared ASR performance against original recordings.Results reveal that tonal languages experience substantially larger performance degradation than nontonal languages.Analysis of tone confusion matrices shows systematic patterns of misidentification where contour tones collapse toward level tones when pitch information is removed.Calculation of tone's functional load at syllable and word levels demonstrates that syllablelevel functional load strongly predicts ASR vulnerability to pitch flattening, while word-level patterns reflect each language's morphological structure.These findings illuminate the differential importance of pitch information across languages and suggest that ASR systems for languages with high syllable-level functional load require more robust pitch modeling.

Authors

Institutions

Publication Details

Published
2025-01-01
DOI
https://doi.org/10.18653/v1/2025.sigtyp-1.11
Primary Topic
Handwritten Text Recognition Techniques
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Tone in Perspective: A Computational Typological Analysis of Tone Function in ASR

Gina‐Anne Levow, Siyu Liang
Handwritten Text Recognition Techniques
article

Tone in Perspective: A Computational Typological Analysis of Tone Function in ASR

Gina‐Anne Levow, Siyu Liang
article en

Abstract

This study investigates the impact of pitch flattening on automatic speech recognition (ASR) performance across tonal and non-tonal languages.Using vocoder-based signal processing techniques, we created pitch-flattened versions of speech recordings and compared ASR performance against original recordings.Results reveal that tonal languages experience substantially larger performance degradation than nontonal languages.Analysis of tone confusion matrices shows systematic patterns of misidentification where contour tones collapse toward level tones when pitch information is removed.Calculation of tone's functional load at syllable and word levels demonstrates that syllablelevel functional load strongly predicts ASR vulnerability to pitch flattening, while word-level patterns reflect each language's morphological structure.These findings illuminate the differential importance of pitch information across languages and suggest that ASR systems for languages with high syllable-level functional load require more robust pitch modeling.

University of Washington (US)
Openalex Percentile: Top 82%
Handwritten Text Recognition Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.