CapGenie: Realtime Caption Generator

The increasing reliance on multimedia content has heightened the need for inclusive technologies, particularly for individuals with hearing impairments. This paper presents a Real-Time Caption Generator that leverages a Whisper ASR model to convert video audio into accurate, synchronized captions with <500ms end-to-end latency. The system addresses accessibility gaps through a React-based interactive interface, enabling users to customize caption display settings (font style, size, and opacity) for optimal readability. Experimental results demonstrate >90% word accuracy on clean speech datasets

Authors

Publication Details

Journal
International Journal of Advanced Research in Science Communication and Technology
Published
2025-04-05
DOI
https://doi.org/10.48175/ijarsct-24918
Primary Topic
Video Analysis and Summarization
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

CapGenie: Realtime Caption Generator

Manav Mishra, Mihar S. Shaikh, Samira Shaikh, Prof. Amarja Adgaonkar et al.
International Journal of Advanced Research in Science Communication and Technology
Video Analysis and Summarization
article

CapGenie: Realtime Caption Generator

Manav Mishra, Mihar S. Shaikh, Samira Shaikh, Prof. Amarja Adgaonkar, Viraj Bhor
article en

Abstract

The increasing reliance on multimedia content has heightened the need for inclusive technologies, particularly for individuals with hearing impairments. This paper presents a Real-Time Caption Generator that leverages a Whisper ASR model to convert video audio into accurate, synchronized captions with <500ms end-to-end latency. The system addresses accessibility gaps through a React-based interactive interface, enabling users to customize caption display settings (font style, size, and opacity) for optimal readability. Experimental results demonstrate >90% word accuracy on clean speech datasets

International Journal of Advanced Research in Science Communication and Technology
Openalex Percentile: Top 95%
Video Analysis and Summarization
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.