Development and Evaluation of a Multimodal Sensory Integrated Device for Autonomous Grocery Assistance for Visually Impaired Filipinos

Grocery shopping, a routine activity, becomes a significant challenge for individuals with visual impairments (PVIs) due to barriers in accessing product information such as nutritional facts, allergens, and expiration dates. This study introduces GaBuy, a multimodal sensory-integrated (MSID) assistive device designed to enhance the grocery shopping experience for PVIs by addressing key variables: independence, readability, convenience, accuracy, and efficiency. Initial surveys conducted with 35 visually impaired participants identified critical pain points, including difficulties in locating products, reading labels, and relying on external assistance. These insights guided the design and development of GaBuy, which integrates text-to-speech capabilities and streamlined product identification features. A simulation-based study compared participants' experiences between traditional grocery shopping methods (pre-treatment) and the use of GaBuy (post-treatment). Data analyzed using the Wilcoxon Signed-Rank Test revealed statistically significant improvements across all five key variables. Participants reported increased autonomy, reduced cognitive strain, and greater ease in acquiring essential product details, highlighting GaBuy's potential. This research bridges existing gaps in assistive technology by offering a user-centered solution that promotes inclusivity, independence, and accessibility for PVIs in grocery shopping environments. GaBuy sets a benchmark for future innovations, empowering PVIs to navigate daily tasks with confidence and dignity.