Smart Object Detection and Audio Feedback System for the Visually Impaired

This paper proposes a new assistive system, "Sight Through Sound," that is intended to improve the mobility and independence of visually impaired people. With real-time detection of objects and audio-based feedback, the system overcomes current solution shortcomings including high expenditure, inability to adapt in real time, and poor language support. The proposed system combines YOLO and Faster R-CNN-based advanced object detection algorithms with IoT-based hardware including Raspberry Pi and ESP32-CAM for seamless processing. Obstacles are detected using ultrasonic sensors and a kannada text-to-speech (TTS) module is used to deliver localized audio cues. Results from experiments show greater accuracy and responsiveness than existing technologies and provide a scalable and cost-effective solution that enables visually impaired users to move independently with greater situational awareness.

Authors

Institutions

Publication Details

Published
2025-07-25
DOI
https://doi.org/10.1109/isac364032.2025.11156667
Primary Topic
Currency Recognition and Detection
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Smart Object Detection and Audio Feedback System for the Visually Impaired

S Hemanth, D. Gracia Nirmala Rani, S Mallikarjunaswamy, S. J. Sheela et al.
Currency Recognition and Detection
article

Smart Object Detection and Audio Feedback System for the Visually Impaired

S Hemanth, D. Gracia Nirmala Rani, S Mallikarjunaswamy, S. J. Sheela, H S Sameena, B. Veena, Jyothi Rikhab Chand, N Sharmila, G. Nidhishree
article en

Abstract

This paper proposes a new assistive system, "Sight Through Sound," that is intended to improve the mobility and independence of visually impaired people. With real-time detection of objects and audio-based feedback, the system overcomes current solution shortcomings including high expenditure, inability to adapt in real time, and poor language support. The proposed system combines YOLO and Faster R-CNN-based advanced object detection algorithms with IoT-based hardware including Raspberry Pi and ESP32-CAM for seamless processing. Obstacles are detected using ultrasonic sensors and a kannada text-to-speech (TTS) module is used to deliver localized audio cues. Results from experiments show greater accuracy and responsiveness than existing technologies and provide a scalable and cost-effective solution that enables visually impaired users to move independently with greater situational awareness.

JSS Academy of Higher Education and Research (IN), Global College (CY), JSS Science and Technology University (IN)
Openalex Percentile: Top 76%
Currency Recognition and Detection
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Smart Object Detection and Audio Feedback System for the Visually Impaired — S Hemanth, D. Gracia Nirmala Rani, et al. · (2025) | TGRS Research Map | TGRS