EchoAid: Enhancing Livestream Shopping Accessibility for the DHH Community
Livestream shopping platforms often overlook the accessibility needs of the Deaf and Hard of Hearing (DHH) community, leading to barriers such as information inaccessibility and overload. To tackle these challenges, we developed EchoAid, a mobile app designed to improve the livestream shopping experience for DHH users. EchoAid utilizes advanced speech-to-text conversion, Rapid Serial Visual Presentation (RSVP) technology, and Large Language Models (LLMs) to simplify the complex information flow in live sales environments. We conducted exploratory studies with eight DHH individuals to identify design needs and iteratively developed the EchoAid prototype based on feedback from three participants. We then evaluate the performance of this system in a user study workshop involving 38 DHH participants. Our findings demonstrate the successful design and validation process of EchoAid, highlighting its potential to enhance product information extraction, leading to reduced cognitive overload and more engaging and customized shopping experiences for DHH users.
Authors
- Muzhi Zhou (ORCID: https://orcid.org/0000-0001-5488-206X)
- Changyang He (ORCID: https://orcid.org/0000-0001-6648-4456)
- Hui Pan (ORCID: https://orcid.org/0000-0001-5748-7217)
- Zheng Wei (ORCID: https://orcid.org/0000-0003-1559-7148)
- Xian Xu (ORCID: https://orcid.org/0000-0002-7000-749X)
- Zeyu Yang (ORCID: https://orcid.org/0000-0002-8730-8811)
- Yang Zhang
Institutions
- Hong Kong University of Science and Technology (HK)
- Tencent (China) (CN)
- Guangzhou University (CN)
- Max Planck Institute for Security and Privacy (DE)
- University of Hong Kong (HK)
- South China University of Technology (CN)
Publication Details
- Journal
- Proceedings of the ACM on Human-Computer Interaction
- Published
- 2025-10-16
- DOI
- https://doi.org/10.1145/3757471
- Primary Topic
- Hearing Impairment and Communication
- Type
- article
- Field-Weighted Citation Impact
- 0.00