Memory Reviver: Supporting Photo-Collection Reminiscence for People with Visual Impairment via a Proactive Chatbot
Reminiscing with photo collections offers significant psychological benefits but poses challenges for people with visual impairment (PVI). Their current reliance on sighted help restricts the flexibility of this activity. In response, we explored using a chatbot in a preliminary study. We identified two primary challenges that hinder effective reminiscence with a chatbot: the scattering of information and a lack of proactive guidance. To address these limitations, we present Memory Reviver, a proactive chatbot that helps PVI reminisce with a photo collection through natural language communication. Memory Reviver incorporates two novel features: (1) a Memory Tree, which uses a hierarchical structure to organize the information in a photo collection; and (2) a Proactive Strategy, which actively delivers information to users at proper conversation rounds. Evaluation with twelve PVI demonstrated that Memory Reviver effectively facilitated engaging reminiscence, enhanced understanding of photo collections, and delivered natural conversational experiences. Based on our findings, we distill implications for supporting photo reminiscence and designing chatbots for PVI.
Authors
- Yukang Yan (ORCID: https://orcid.org/0000-0001-7515-3755)
- Xiaofu Jin (ORCID: https://orcid.org/0000-0002-7239-3769)
- Huamin Qu (ORCID: https://orcid.org/0000-0002-3344-9694)
- Chang Chen (ORCID: https://orcid.org/0009-0008-5876-7219)
- Lin-Ping Yuan
- Shuchang Xu (ORCID: https://orcid.org/0000-0002-7642-9044)
- Zichen Liu (ORCID: https://orcid.org/0009-0009-0078-6238)
Institutions
- Hong Kong University of Science and Technology (HK)
- University of Rochester (US)
- University of Hong Kong (HK)
Publication Details
- Published
- 2024-10-11
- DOI
- https://doi.org/10.1145/3654777.3676336
- Citations
- 14
- Primary Topic
- Multimodal Machine Learning Applications
- Type
- article
- Field-Weighted Citation Impact
- 3.49