NAIN: Real-Time Object Detection and Navigation Assistance for the Visually Impaired using Single Shot Detector Model

Navigation for the Blind and Visually Impaired (BVI) poses a huge challenge due to lack of environmental cues. This research article proposes "NAIN" (Navigational Aid for the INsight-impaired) - an app for real-time object detection and navigation assistance for the BVI built using Python frameworks like Flask and OpenCV. Video frames from the camera are processed to recognize objects using the Single Shot Detector deep learning model implemented in TensorFlow. Detected objects are annotated with labels, proximity estimates, and communicated to the user via text-to-speech conversion and audio feedback. Object width in terms of pixels is mapped to real-world dimensions using the focal length of 500 pixels to provide distance estimates of objects like "Person detected at 300 cm". Quantitative testing shows over 90% accuracy in classifying daily objects. Distance approximation methodology provides 80% precise results for objects within 1000cm when properly calibrated. Initial trials illustrate reliable detection even in cluttered environments resulting in more confident indoor navigation. On the software architecture side, Flask enables graceful scaling of the detection pipeline across the client and server. HTML and CSS used in crafting an accessible interface optimized for use via screen readers. The system is designed for computational efficiency working in real-time without internet connectivity. It provides a template to develop affordable assisted perception for the BVI using computer vision. Future efforts look to enrich object libraries, integrate mapping APIs for outdoor settings, and provide navigation vectors around obstacles. By converting visual data into meaningful and intuitive audio cues, to raise awareness that can empower the BVI with greater mobility and independence.

Authors

Institutions

Publication Details

Published
2024-11-06
DOI
https://doi.org/10.1109/icacc63692.2024.10845367
Citations
1
Primary Topic
Tactile and Sensory Interactions
Type
article
Field-Weighted Citation Impact
0.34
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

NAIN: Real-Time Object Detection and Navigation Assistance for the Visually Impaired using Single Shot Detector Model

Shikha Agrawal, Nisha Varghese, Manoj Gupta
1 citations
Tactile and Sensory Interactions
0.34
article

NAIN: Real-Time Object Detection and Navigation Assistance for the Visually Impaired using Single Shot Detector Model

Shikha Agrawal, Nisha Varghese, Manoj Gupta
article en
1 citations

Abstract

Navigation for the Blind and Visually Impaired (BVI) poses a huge challenge due to lack of environmental cues. This research article proposes "NAIN" (Navigational Aid for the INsight-impaired) - an app for real-time object detection and navigation assistance for the BVI built using Python frameworks like Flask and OpenCV. Video frames from the camera are processed to recognize objects using the Single Shot Detector deep learning model implemented in TensorFlow. Detected objects are annotated with labels, proximity estimates, and communicated to the user via text-to-speech conversion and audio feedback. Object width in terms of pixels is mapped to real-world dimensions using the focal length of 500 pixels to provide distance estimates of objects like "Person detected at 300 cm". Quantitative testing shows over 90% accuracy in classifying daily objects. Distance approximation methodology provides 80% precise results for objects within 1000cm when properly calibrated. Initial trials illustrate reliable detection even in cluttered environments resulting in more confident indoor navigation. On the software architecture side, Flask enables graceful scaling of the detection pipeline across the client and server. HTML and CSS used in crafting an accessible interface optimized for use via screen readers. The system is designed for computational efficiency working in real-time without internet connectivity. It provides a template to develop affordable assisted perception for the BVI using computer vision. Future efforts look to enrich object libraries, integrate mapping APIs for outdoor settings, and provide navigation vectors around obstacles. By converting visual data into meaningful and intuitive audio cues, to raise awareness that can empower the BVI with greater mobility and independence.

Christ University (IN)
Openalex Percentile: Top 37%
Tactile and Sensory Interactions
0.34
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

NAIN: Real-Time Object Detection and Navigation Assistance for the Visually Impaired using Single Shot Detector Model — Shikha Agrawal, Nisha Varghese, et al. · (2024) | TGRS Research Map | TGRS