VISION: Visually Impaired Support Through Intelligent Object Narration

Visually impaired individuals often struggle to identify clothing and make independent shopping decisions. Existing object recognition systems provide only basic identification and lack detailed descriptions like color, pattern, or style. As a result, they rely on others to choose outfits or shop for new clothes. Our project helps bridge this gap by capturing an image of an apparel item, describing its key features in detail, and even suggesting similar options available online with their prices. This enables visually impaired users to explore and compare clothing independently, making fashion more accessible to them. We use deep learning models for apparel recognition and natural language processing (NLP) to generate accurate descriptions. A key feature of our system is Beam Search, which improves the accuracy of generated captions by selecting the most relevant descriptions. Additionally, APIs are integrated to fetch online comparisons, and a voice- based interface ensures easy interaction, making shopping more accessible and independent.

Authors

Institutions

Publication Details

Published
2025-07-18
DOI
https://doi.org/10.1109/accthpa65749.2025.11168781
Primary Topic
Tactile and Sensory Interactions
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

VISION: Visually Impaired Support Through Intelligent Object Narration

M. Govind, Ravi Hariprasad, Ierin Babu, Agnes Shibu et al.
Tactile and Sensory Interactions
article

VISION: Visually Impaired Support Through Intelligent Object Narration

M. Govind, Ravi Hariprasad, Ierin Babu, Agnes Shibu, Gregory Kurien
article en

Abstract

Visually impaired individuals often struggle to identify clothing and make independent shopping decisions. Existing object recognition systems provide only basic identification and lack detailed descriptions like color, pattern, or style. As a result, they rely on others to choose outfits or shop for new clothes. Our project helps bridge this gap by capturing an image of an apparel item, describing its key features in detail, and even suggesting similar options available online with their prices. This enables visually impaired users to explore and compare clothing independently, making fashion more accessible to them. We use deep learning models for apparel recognition and natural language processing (NLP) to generate accurate descriptions. A key feature of our system is Beam Search, which improves the accuracy of generated captions by selecting the most relevant descriptions. Additionally, APIs are integrated to fetch online comparisons, and a voice- based interface ensures easy interaction, making shopping more accessible and independent.

Adamas University (IN)
Openalex Percentile: Top 74%
Tactile and Sensory Interactions
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.