ViSQA: A benchmark dataset and baseline models for Vietnamese spoken question answering
Spoken Question Answering (SQA) extends machine reading comprehension to spoken content and requires models to handle both automatic speech recognition (ASR) errors and downstream language understanding. Although large-scale SQA benchmarks exist for high-resource languages, Vietnamese remains underexplored due to the lack of standardized datasets. This paper introduces ViSQA, the first benchmark for Vietnamese Spoken Question Answering. ViSQA extends the UIT-ViQuAD corpus using a reproducible text-to-speech and ASR pipeline, resulting in over 13,000 question-answer pairs aligned with spoken inputs. The dataset includes clean and noise-degraded audio variants to enable systematic evaluation under varying transcription quality. Experiments with five transformer-based models show that ASR errors substantially degrade performance (e.g., ViT5 EM: 62.04% [Formula: see text] 36.30%), while training on spoken transcriptions improves robustness (ViT5 EM: 36.30% [Formula: see text] 50.70%). ViSQA provides a rigorous benchmark for evaluating Vietnamese SQA systems and enables systematic analysis of the impact of ASR errors on downstream reasoning.
Authors
- Le Van Quan
- Ngo Duc Tam
- Le Trong Minh
- Nguyen Duc Thinh
- Nguyen Khanh Tho Loc
- Le Hoang Son
Institutions
- Vietnam National University, Hanoi (VN)
- Thuyloi University (VN)
Publication Details
- Journal
- PLoS ONE
- Published
- 2026-01-12
- DOI
- https://doi.org/10.1371/journal.pone.0340771
- Primary Topic
- Speech Recognition and Synthesis
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- Đại học Quốc gia Hà Nội