Simultaneous Translation with Offline Speech and LLM Models in CUNI Submission to IWSLT 2025

This paper describes Charles University submission to the Simultaneous Speech Translation Task of the IWSLT 2025.We cover all four language pairs with a direct or cascade approach.The backbone of our systems is the offline Whisper speech model, which we use for both translation and transcription in simultaneous mode with the state-of-the-art simultaneous policy AlignAtt.We further improve the performance by prompting to inject in-domain terminology, and we accommodate context.Our cascaded systems further use EuroLLM for unbounded simultaneous translation.Compared to the Organizers' baseline, our systems improve by 2 BLEU points on Czech to English and 13-22 BLEU points on English to German, Chinese and Japanese on the development sets.Additionally, we also propose a new enhanced measure of speech recognition latency.

Authors

Publication Details

Published
2025-01-01
DOI
https://doi.org/10.18653/v1/2025.iwslt-1.41
Primary Topic
Speech Recognition and Synthesis
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Simultaneous Translation with Offline Speech and LLM Models in CUNI Submission to IWSLT 2025

Peter Polák, Dominik Macháček
Speech Recognition and Synthesis
article

Simultaneous Translation with Offline Speech and LLM Models in CUNI Submission to IWSLT 2025

Peter Polák, Dominik Macháček
article en

Abstract

This paper describes Charles University submission to the Simultaneous Speech Translation Task of the IWSLT 2025.We cover all four language pairs with a direct or cascade approach.The backbone of our systems is the offline Whisper speech model, which we use for both translation and transcription in simultaneous mode with the state-of-the-art simultaneous policy AlignAtt.We further improve the performance by prompting to inject in-domain terminology, and we accommodate context.Our cascaded systems further use EuroLLM for unbounded simultaneous translation.Compared to the Organizers' baseline, our systems improve by 2 BLEU points on Czech to English and 13-22 BLEU points on English to German, Chinese and Japanese on the development sets.Additionally, we also propose a new enhanced measure of speech recognition latency.

Gender equality
Openalex Percentile: Top 90%
Speech Recognition and Synthesis
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.