Smart Cane with Object Recognition System

The proposed audio guidance system is a cutting-edge solution designed to assist visually impaired individuals in navigating their surroundings safely and independently. The innovative device utilizes a combination of sensors, cameras, and audio feedback mechanisms to detect nearby objects and provide real-time alerts to the user, enhancing their mobility and reducing the risk of accidents. By integrating components such as the HC-SR04 ultrasonic detector, NodeMCU, ESP32 camera, GPS, and GSM module, the system accurately estimates distances, identifies objects through image processing techniques, and transforms the output into audio cues for the user. The HC-SR04 ultrasonic sensor, in conjunction with the NodeMCU microcontroller, measures the distance between the user and obstacles by emitting ultrasonic pulses and calculating the time it takes for them to return. The ESP32 camera captures images of the user’s surroundings, which are then processed using OpenCV to identify objects and annotate them with bounding boxes. The ISD1820 module converts this information into audio alerts, providing the user with verbal feedback about the objects detected. Additionally, the integration of a GPS module enables the system to track the user’s location and send alerts to designated caregivers in case of emergencies. The outcome demonstrates the system’s remarkable accuracy in detecting objects within a 3-meter range, significantly improving the user’s ability to navigate their environment safely. Furthermore, the inclusion of a voice annunciator system and a designated button within the cane enhances user experience by providing convenient access to audio feedback and location sharing functionalities. The paper presents a significant advancement in assistive technology, offering a comprehensive solution to address the mobility challenges faced by visually impaired individuals.