TABR: Tone-Auxiliary Base-Syllable Rescoring for Low-Resource Tujia Speech Recognition

Tujia is a low-resource endangered language, and its digital documentation and preservation are of considerable importance. The scarcity of transcribed speech data leads to low recognition accuracy in Tujia automatic speech recognition (ASR). We propose Tone-Auxiliary Base-syllable Rescoring (TABR), a two-stage framework built on XLS-R-300M. In Stage I, complete tone-marked Tujia Pinyin syllables are the primary recognition targets, while transcription-derived tone labels provide auxiliary supervision to the shared encoder. In Stage II, an independently trained base-syllable recognizer scores the tone-stripped forms of first-pass hypotheses to rerank the original candidates. Neither derived representation requires additional manual annotation. On a coverage-constrained split of a 2.485 h corpus, TABR reduces syllable error rate from 33.53% to 30.89% and Pinyin character error rate from 17.34% to 15.54% compared with the Baseline, with all results averaged over three random seeds. Paired bootstrap analyses support both improvements. Component controls compare auxiliary targets and second-pass representations. Lower mean errors are also observed after retraining on a split without coverage reassignment and when applying models trained on the original split to one unseen speaker within the same book-derived condition. These findings support TABR under the evaluated conditions.

Authors

Institutions

Publication Details

Journal
Applied Sciences
Published
2026-10-28
DOI
https://doi.org/10.3390/app162110681
Primary Topic
Speech Recognition and Synthesis
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

TABR: Tone-Auxiliary Base-Syllable Rescoring for Low-Resource Tujia Speech Recognition

Jianfeng Li, Jingyuan Zhang, Ziyang Hu, Ding Jiang
Applied Sciences
Speech Recognition and Synthesis
article

TABR: Tone-Auxiliary Base-Syllable Rescoring for Low-Resource Tujia Speech Recognition

Jianfeng Li, Jingyuan Zhang, Ziyang Hu, Ding Jiang
article en

Abstract

Tujia is a low-resource endangered language, and its digital documentation and preservation are of considerable importance. The scarcity of transcribed speech data leads to low recognition accuracy in Tujia automatic speech recognition (ASR). We propose Tone-Auxiliary Base-syllable Rescoring (TABR), a two-stage framework built on XLS-R-300M. In Stage I, complete tone-marked Tujia Pinyin syllables are the primary recognition targets, while transcription-derived tone labels provide auxiliary supervision to the shared encoder. In Stage II, an independently trained base-syllable recognizer scores the tone-stripped forms of first-pass hypotheses to rerank the original candidates. Neither derived representation requires additional manual annotation. On a coverage-constrained split of a 2.485 h corpus, TABR reduces syllable error rate from 33.53% to 30.89% and Pinyin character error rate from 17.34% to 15.54% compared with the Baseline, with all results averaged over three random seeds. Paired bootstrap analyses support both improvements. Component controls compare auxiliary targets and second-pass representations. Lower mean errors are also observed after retraining on a split without coverage reassignment and when applying models trained on the original split to one unseen speaker within the same book-derived condition. These findings support TABR under the evaluated conditions.

Applied SciencesVol. 16(21)
Jishou University (CN)
Jishou University
Openalex Percentile: Top 14%
Speech Recognition and Synthesis
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon