StreetNav: Leveraging Street Cameras to Support Precise Outdoor Navigation for Blind Pedestrians
Blind and low-vision (BLV) people rely on GPS-based systems for outdoor navigation. GPS’s inaccuracy, however, causes them to veer off track, run into obstacles, and struggle to reach precise destinations. While prior work has made precise navigation possible indoors via hardware installations, enabling this outdoors remains a challenge. Interestingly, many outdoor environments are already instrumented with hardware such as street cameras. In this work, we explore the idea of repurposing existing street cameras for outdoor navigation. Our community-driven approach considers both technical and sociotechnical concerns through engagements with various stakeholders: BLV users, residents, business owners, and Community Board leadership. The resulting system, StreetNav, processes a camera’s video feed using computer vision and gives BLV pedestrians real-time navigation assistance. Our evaluations show that StreetNav guides users more precisely than GPS, but its technical performance is sensitive to environmental occlusions and distance from the camera. We discuss future implications for deploying such systems at scale.
Authors
- Zoran Kostić (ORCID: https://orcid.org/0000-0002-3691-2840)
- Xin Yi Therese Xu
- Mahshid Ghasemi (ORCID: https://orcid.org/0000-0002-0331-553X)
- Michael Malcolm (ORCID: https://orcid.org/0000-0002-7440-7298)
- Mehmet Kerem Türkcan (ORCID: https://orcid.org/0000-0001-9273-7293)
- Sophie Ana Paris (ORCID: https://orcid.org/0009-0002-4284-4220)
- Gil Zussman (ORCID: https://orcid.org/0000-0002-1845-4460)
- Gaurav Jain (ORCID: https://orcid.org/0000-0002-9084-9395)
- Javad Ghaderi (ORCID: https://orcid.org/0000-0001-8038-550X)
- Zihao Zhang (ORCID: https://orcid.org/0009-0007-5312-5340)
- Basel Hindi (ORCID: https://orcid.org/0000-0002-3136-6051)
- Brian A. Smith (ORCID: https://orcid.org/0000-0003-2540-0839)
- Koushik Srinivasula (ORCID: https://orcid.org/0009-0004-6387-9769)
- Mingyu Xie (ORCID: https://orcid.org/0009-0008-5156-5032)
- Daniel Weiner (ORCID: https://orcid.org/0009-0009-3199-0805)
Institutions
- Lehman College (US)
- Pomona College (US)
- New York University (US)
- New York City College of Technology (US)
- Columbia University (US)
Publication Details
- Published
- 2024-10-11
- DOI
- https://doi.org/10.1145/3654777.3676333
- Citations
- 11
- Primary Topic
- Tactile and Sensory Interactions
- Type
- article
- Field-Weighted Citation Impact
- 3.77