Silent Speech Recognition

Lip reading using artificial intelligence aims to convert visual speech movements into readable text without relying on audio signals. This project presents an AI-based lip reading system that predicts spoken text from video input using deep learning techniques. The system processes uploaded video files and extracts visual features of lip movements, which are analyzed using pre-trained models such as LipNet with LSTM and CTC-based decoding. A Streamlit-based web interface is developed to allow users to upload videos and view the predicted text output easily. The proposed system demonstrates the ability to recognize and translate visual speech into characters, making it useful for assisting hearing-impaired individuals and speech recognition in noisy environments.

Authors

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-01-05
DOI
https://doi.org/10.5281/zenodo.18151662
Primary Topic
Speech and Audio Processing
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Silent Speech Recognition

S. Adithi, Aaliya Waseem, K N Pratheeksha
Zenodo (CERN European Organization for Nuclear Research)
Speech and Audio Processing
article

Silent Speech Recognition

S. Adithi, Aaliya Waseem, K N Pratheeksha
article en

Abstract

Lip reading using artificial intelligence aims to convert visual speech movements into readable text without relying on audio signals. This project presents an AI-based lip reading system that predicts spoken text from video input using deep learning techniques. The system processes uploaded video files and extracts visual features of lip movements, which are analyzed using pre-trained models such as LipNet with LSTM and CTC-based decoding. A Streamlit-based web interface is developed to allow users to upload videos and view the predicted text output easily. The proposed system demonstrates the ability to recognize and translate visual speech into characters, making it useful for assisting hearing-impaired individuals and speech recognition in noisy environments.

Zenodo (CERN European Organization for Nuclear Research)
Quality Education
Openalex Percentile: Top 96%
Speech and Audio Processing
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.