Development of a Fully Autonomous Offline Assistive System for Visually Impaired Individuals: A Privacy-First Approach
Visual impairment affects millions worldwide, creating significant barriers to environmental interaction and independence. Existing assistive technologies often rely on cloud-based processing, raising privacy concerns and limiting accessibility in resource-constrained environments. This paper explores the integration and potential of open-source AI models in developing a fully offline assistive system that can be locally set up and operated to support visually impaired individuals. Built on a Raspberry Pi 5, the system combines real-time object detection (YOLOv8), optical character recognition (Tesseract), face recognition with voice-guided registration, and offline voice command control (VOSK), delivering hands-free multimodal interaction without dependence on cloud infrastructure. Audio feedback is generated using Piper for real-time environmental awareness. Designed to prioritize user privacy, low latency, and affordability, the platform demonstrates that effective assistive functionality can be achieved using only open-source tools on low-power edge hardware. Evaluation results in controlled conditions show 75-90% detection and recognition accuracies, with sub-second response times, confirming the feasibility of deploying such systems in privacy-sensitive or resource-constrained environments.
Authors
- Mohammad Al Bataineh (ORCID: https://orcid.org/0000-0003-0148-7618)
- Dana I. Abu-Abdoun (ORCID: https://orcid.org/0000-0003-3699-8020)
- Winner Abula
- Simon Darota (ORCID: https://orcid.org/0009-0005-8921-4711)
- Fitsum Yebeka Mekonnen
- Ahmed Serag
- Kena Teshale Tamiru
Institutions
- Khalifa University of Science and Technology (AE)
- United Arab Emirates University (AE)
Publication Details
- Journal
- Sensors
- Published
- 2025-09-29
- DOI
- https://doi.org/10.3390/s25196006
- Citations
- 1
- Primary Topic
- Tactile and Sensory Interactions
- Type
- article
- Field-Weighted Citation Impact
- 1.43
Funders
- United Arab Emirates University