Explore, Listen, Inspect: Supporting Multimodal Interaction with 3D Surface and Point Data Visualizations

Blind and low-vision (BLV) users remain largely excluded from three-dimensional (3D) surface and point data visualizations due to the reliance on visual interaction. Existing approaches inadequately support non-visual access, especially in browser-based environments. This study introduces DIXTRAL, a hosted web-native system, co-designed with BLV researchers to address these gaps through multimodal interaction. Conducted with two blind and one sighted researcher, this study took place over sustained design sessions. Data were gathered through iterative testing of the prototype, collecting feedback on spatial navigation, sonification, and usability. Co-design observations demonstrate that synchronized auditory, visual, and textual feedback, combined with keyboard and gamepad navigation, enhances both structure discovery and orientation. DIXTRAL aims to improve access to 3D continuous scalar fields for BLV users and inform best practices for creating inclusive 3D visualizations.

Authors

Institutions

Publication Details

Published
2025-10-22
DOI
https://doi.org/10.1145/3663547.3759765
Primary Topic
Interactive and Immersive Displays
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Explore, Listen, Inspect: Supporting Multimodal Interaction with 3D Surface and Point Data Visualizations

Sanchita S. Kamath, Aziz Zeidieh, JooYoung Seo
Interactive and Immersive Displays
article

Explore, Listen, Inspect: Supporting Multimodal Interaction with 3D Surface and Point Data Visualizations

Sanchita S. Kamath, Aziz Zeidieh, JooYoung Seo
article en

Abstract

Blind and low-vision (BLV) users remain largely excluded from three-dimensional (3D) surface and point data visualizations due to the reliance on visual interaction. Existing approaches inadequately support non-visual access, especially in browser-based environments. This study introduces DIXTRAL, a hosted web-native system, co-designed with BLV researchers to address these gaps through multimodal interaction. Conducted with two blind and one sighted researcher, this study took place over sustained design sessions. Data were gathered through iterative testing of the prototype, collecting feedback on spatial navigation, sonification, and usability. Co-design observations demonstrate that synchronized auditory, visual, and textual feedback, combined with keyboard and gamepad navigation, enhances both structure discovery and orientation. DIXTRAL aims to improve access to 3D continuous scalar fields for BLV users and inform best practices for creating inclusive 3D visualizations.

University of Illinois Urbana-Champaign (US)
Openalex Percentile: Top 70%
Interactive and Immersive Displays
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Explore, Listen, Inspect: Supporting Multimodal Interaction with 3D Surface and Point Data Visualizations — Sanchita S. Kamath, Aziz Zeidieh, et al. · (2025) | TGRS Research Map | TGRS