HITSZ’s End-To-End Speech Translation Systems Combining Sequence-to-Sequence Auto Speech Recognition Model and Indic Large Language Model for IWSLT 2025 in Indic Track
This paper presents HITSZ's submission for the IWSLT 2025 Indic track, focusing on speech-to-text translation (ST) for English-to-Indic and Indic-to-English language pairs.To enhance translation quality in this low-resource scenario, we propose an end-to-end system integrating the pre-trained Whisper automated speech recognition (ASR) model with Krutrim, an Indic-specialized large language model (LLM).Experimental results demonstrate that our end-to-end system achieved average BLEU scores of 28.88 for English-to-Indic directions and 27.86 for Indic-to-English directions.Furthermore, we investigated the Chain-of-Thought (CoT) method.While this method showed potential for significant translation quality improvements on successfully parsed outputs (e.g. a 13.84 BLEU increase for Tamil-to-English), we observed challenges in ensuring the model consistently adheres to the required CoT output format.
Authors
- Kehai Chen (ORCID: https://orcid.org/0000-0002-4346-7618)
- Hailang Liu
- Xu Wei (ORCID: https://orcid.org/0000-0001-7977-4487)
- Yangxin Wu
- M. Zhang (ORCID: https://orcid.org/0000-0001-8659-5727)
- Xuefeng Bai (ORCID: https://orcid.org/0000-0001-7044-0683)
- Yaoyin Zhang
Institutions
- Harbin Institute of Technology (CN)
Publication Details
- Published
- 2025-01-01
- DOI
- https://doi.org/10.18653/v1/2025.iwslt-1.43
- Primary Topic
- Speech Recognition and Synthesis
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- National Natural Science Foundation of China
- Basic and Applied Basic Research Foundation of Guangdong Province