A Machine Learning-Based App for Sound Detection and Speech Recognition for the Deaf and Hard of Hearing

This project uses AI to improve safety and communication for the deaf and hard-of-hearing community in Saudi Arabia. By combining real-time sound detection and speech recognition, it offers alerts for potential dangers and supports communication. The system is built with Android Studio, TensorFlow Lite, and Speech-to-Text APIs. The core model uses YAMNet for feature extraction and a Deep Neural Network (DNN) for classification, achieving 95.77% accuracy. Future updates will include features like customizable alerts, hazard detection, sign language support, and location tracking, aiming to enhance safety and inclusivity.

Authors

Institutions

Publication Details

Journal
Open Journal of Applied Sciences
Published
2025-01-01
DOI
https://doi.org/10.4236/ojapps.2025.158163
Citations
1
Primary Topic
Speech and Audio Processing
Type
article
Field-Weighted Citation Impact
1.49
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A Machine Learning-Based App for Sound Detection and Speech Recognition for the Deaf and Hard of Hearing

Mohammed Alnuem, Nada Barnawi
1 citations
Open Journal of Applied Sciences
Speech and Audio Processing
1.49
article

A Machine Learning-Based App for Sound Detection and Speech Recognition for the Deaf and Hard of Hearing

Mohammed Alnuem, Nada Barnawi
article en
1 citations

Abstract

This project uses AI to improve safety and communication for the deaf and hard-of-hearing community in Saudi Arabia. By combining real-time sound detection and speech recognition, it offers alerts for potential dangers and supports communication. The system is built with Android Studio, TensorFlow Lite, and Speech-to-Text APIs. The core model uses YAMNet for feature extraction and a Deep Neural Network (DNN) for classification, achieving 95.77% accuracy. Future updates will include features like customizable alerts, hazard detection, sign language support, and location tracking, aiming to enhance safety and inclusivity.

Open Journal of Applied SciencesVol. 15(08)
King Saud University (SA)
Openalex Percentile: Top 15%
Speech and Audio Processing
1.49
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.