Leveraging Multimodal Vision-Language Models for the Visually Impaired

This paper presents a new assistive technology that can potentially enhance the autonomy and quality of life of the blind. The solution involves smart glasses equipped with a built-in camera that records real-time visual information and sends it to a mobile phone for processing. Utilizing advanced computer vision and artificial intelligence algorithms, the system offers a rich and accurate description of the user environment, hence enabling enhanced navigation for the blind. In addition, an interactive web portal has been incorporated to promote awareness of the daily life of the blind, as well as advocate for social integration. The study focuses on the development of an affordable, welfare-based assistive device within the reach of marginalized communities, without compromising high accuracy and reliability. Through the facilitation of an enhanced society and lowered technological barriers, the study hopes to improve the social integration and autonomy of people with disabilities. Empirical evidence and user experience highlight the effectiveness and potential influence of the solution in enhancing the quality of life of visually impaired users.