Qualitative Research of the Multimodal In-Vehicle Interaction Systems Latency Perception

As the automotive industry evolves towards greater technological intelligence, multimodal in-vehicle interaction systems introduce new challenges, particularly in managing system latency-the delay between user input and system response. This study aims to explore how various factors influence latency perception in in-vehicle multimodal interactions, offering a comprehensive framework to guide future design improvements. Our research, conducted in three phases, began with mapping key input and output modalities through literature reviews and expert evaluations. We then examined real-world user experiences to identify specific latency-related issues in common interaction scenarios. Finally, focus groups refined a framework that categorizes tasks based on interaction complexity, sensitivity, and tolerance to latency. The framework highlights how different modalities impact user sensitivity to delays and their tolerance levels, providing valuable insights for designers. It emphasizes that tasks requiring higher cognitive engagement and quicker responses demand more attention to latency. Although focused on intelligent vehicles, the framework is applicable to traditional vehicles with similar systems and aligns with upcoming safety regulations. This research contributes to creating safer, more intuitive in-vehicle systems that enhance user experience and meet regulatory standards.