Development of AI-Based Presentation Application using Deep Learning for Individuals With Disabilities

This study addresses the challenges individuals with disabilities face in controlling presentation devices, particularly in noisy environments, by developing an AI-based application using a hybrid LSTM-GRU model. The primary objective is to improve voice command recognition accuracy for commonly used presentation commands, such as “next” and “back,” even under varying noise conditions. The research employs a hybrid deep learning architecture combining Long Short-Term Memory (LSTM) and Gated Recurrent Unit (GRU) with an attention mechanism to focus on the most relevant temporal features. The model was trained using the Speech Commands Dataset and further fine-tuned with noise-augmented data to simulate real-world environments. Results show that the LSTM-GRU model achieved high accuracy in clean environments and maintained reasonable performance in noisy conditions, outperforming traditional models like Hidden Markov Model (HMM) and Gaussian Mixture Model (GMM). The fine-tuned model, at its optimal epoch, demonstrated robust performance with a balanced precision and recall, making it suitable for deployment in real-world scenarios. The study concludes that while deep learning models offer significant improvements, further refinement is necessary to enhance noise resilience in practical applications

Authors

Institutions

Publication Details

Journal
Building of Informatics Technology and Science (BITS)
Published
2024-12-26
DOI
https://doi.org/10.47065/bits.v6i3.6162
Primary Topic
Speech Recognition and Synthesis
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Development of AI-Based Presentation Application using Deep Learning for Individuals With Disabilities

Gugun Geusan Akbar, Anwar Fitrianto, Carli Apriansyah Hutagalung
Building of Informatics Technology and Science (BITS)
Speech Recognition and Synthesis
article

Development of AI-Based Presentation Application using Deep Learning for Individuals With Disabilities

Gugun Geusan Akbar, Anwar Fitrianto, Carli Apriansyah Hutagalung
article en

Abstract

This study addresses the challenges individuals with disabilities face in controlling presentation devices, particularly in noisy environments, by developing an AI-based application using a hybrid LSTM-GRU model. The primary objective is to improve voice command recognition accuracy for commonly used presentation commands, such as “next” and “back,” even under varying noise conditions. The research employs a hybrid deep learning architecture combining Long Short-Term Memory (LSTM) and Gated Recurrent Unit (GRU) with an attention mechanism to focus on the most relevant temporal features. The model was trained using the Speech Commands Dataset and further fine-tuned with noise-augmented data to simulate real-world environments. Results show that the LSTM-GRU model achieved high accuracy in clean environments and maintained reasonable performance in noisy conditions, outperforming traditional models like Hidden Markov Model (HMM) and Gaussian Mixture Model (GMM). The fine-tuned model, at its optimal epoch, demonstrated robust performance with a balanced precision and recall, making it suitable for deployment in real-world scenarios. The study concludes that while deep learning models offer significant improvements, further refinement is necessary to enhance noise resilience in practical applications

Building of Informatics Technology and Science (BITS)Vol. 6(3)
State University of Jakarta (ID)
Openalex Percentile: Top 73%
Speech Recognition and Synthesis
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.