Real-Time Subtitle Generation for Live Videos Using AI and Machine Learning

Real-time subtitling of live video streams is still a major challenge because of the difficulties involved in processing spontaneous speech, dealing with multiple speakers, and coping with varying audio conditions with low latency. This research compares the performance of an end-to-end automatic subtitling system that integrates state-of-the-art automatic speech recognition (ASR) with sophisticated natural language processing. Processed 500 hours of live broadcast content in news, sports, and entertainment segments with a hybrid architecture that combined bidirectional LSTM networks and transformer models. Results indicate a 94.2%-word accuracy rate with an average latency of 1.2 seconds, which is a 27 % improvement over current systems. The system was especially strong in dealing with domain-specific vocabulary and subtitle synchronization during rapid speaker changes. Our results show that deep learning-based methods can attain near-human quality in real-time subtitle generation and can fulfill broadcast industry latency demands, rendering automatic subtitling ever more feasible for live shows.

Authors

Institutions

Publication Details

Published
2025-04-29
DOI
https://doi.org/10.1109/aimla63829.2025.11041685
Primary Topic
Subtitles and Audiovisual Media
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Real-Time Subtitle Generation for Live Videos Using AI and Machine Learning

Sahil Anand, S. Baghavathi Priya, SSS Shameem
Subtitles and Audiovisual Media
article

Real-Time Subtitle Generation for Live Videos Using AI and Machine Learning

Sahil Anand, S. Baghavathi Priya, SSS Shameem
article en

Abstract

Real-time subtitling of live video streams is still a major challenge because of the difficulties involved in processing spontaneous speech, dealing with multiple speakers, and coping with varying audio conditions with low latency. This research compares the performance of an end-to-end automatic subtitling system that integrates state-of-the-art automatic speech recognition (ASR) with sophisticated natural language processing. Processed 500 hours of live broadcast content in news, sports, and entertainment segments with a hybrid architecture that combined bidirectional LSTM networks and transformer models. Results indicate a 94.2%-word accuracy rate with an average latency of 1.2 seconds, which is a 27 % improvement over current systems. The system was especially strong in dealing with domain-specific vocabulary and subtitle synchronization during rapid speaker changes. Our results show that deep learning-based methods can attain near-human quality in real-time subtitle generation and can fulfill broadcast industry latency demands, rendering automatic subtitling ever more feasible for live shows.

Manipal Academy of Higher Education (IN)
Openalex Percentile: Top 80%
Subtitles and Audiovisual Media
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Real-Time Subtitle Generation for Live Videos Using AI and Machine Learning — Sahil Anand, S. Baghavathi Priya, et al. · (2025) | TGRS Research Map | TGRS