Leveraging AI for Translating English-Captioned YouTube Videos into Regional Languages

YouTube is often the best player in the world of video for entertainment, education, and information. However, most users experience problems in aspects such as downloading videos to perform offline analysis or simply due to poor Internet connectivity or academic purposes. There is also a growing need for automated captioning translation and multilingual access for non-native speakers and non-local users. The research proposes, therefore, the development of an adaptive translation system that deals with YouTube movies extracting captions from video, translating the captions to a specific language, and synchronizing audio video with the translated text along with the original captions. Most of the public existing tools would fail because YouTube sources keep frequently changing. Most of these problems have minimal performance accuracy in captioning or fail to download the captions. The proposed methodology has been imagined to overcome these using AI and ensure performance improvement across various environments It will helpful application for blind users, users seeking knowledge from inclusive education, and those wishing to learn using their mother tongue or overcome language barriers. Advancing toward the vision of national language interaction ensures that people from different languages can enjoy video content regardless of their mother tongue. The future of this application will be a blend of AI-based media processing with a well-designed architecture for future-proofing to improve digital accessibility and to provide a mean scaled-down replacement for real-time language translation in video content.

Authors

Publication Details

Published
2025-03-28
DOI
https://doi.org/10.1109/icdsaai65575.2025.11011636
Primary Topic
Subtitles and Audiovisual Media
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Leveraging AI for Translating English-Captioned YouTube Videos into Regional Languages

Hima Varshita Reddy. S -, Sanjay Swaminathan, Nagendra Kumar D, Santhana Hari S et al.
Subtitles and Audiovisual Media
article

Leveraging AI for Translating English-Captioned YouTube Videos into Regional Languages

Hima Varshita Reddy. S -, Sanjay Swaminathan, Nagendra Kumar D, Santhana Hari S, B Manorohith
article en

Abstract

YouTube is often the best player in the world of video for entertainment, education, and information. However, most users experience problems in aspects such as downloading videos to perform offline analysis or simply due to poor Internet connectivity or academic purposes. There is also a growing need for automated captioning translation and multilingual access for non-native speakers and non-local users. The research proposes, therefore, the development of an adaptive translation system that deals with YouTube movies extracting captions from video, translating the captions to a specific language, and synchronizing audio video with the translated text along with the original captions. Most of the public existing tools would fail because YouTube sources keep frequently changing. Most of these problems have minimal performance accuracy in captioning or fail to download the captions. The proposed methodology has been imagined to overcome these using AI and ensure performance improvement across various environments It will helpful application for blind users, users seeking knowledge from inclusive education, and those wishing to learn using their mother tongue or overcome language barriers. Advancing toward the vision of national language interaction ensures that people from different languages can enjoy video content regardless of their mother tongue. The future of this application will be a blend of AI-based media processing with a well-designed architecture for future-proofing to improve digital accessibility and to provide a mean scaled-down replacement for real-time language translation in video content.

Quality Education
Openalex Percentile: Top 85%
Subtitles and Audiovisual Media
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.