Quantitative Evaluation of User Experience in Digital Voice Assistant Systems: Analyzing Task Completion Time, Success Rate, and User Satisfaction

Dynamic Voice Assistants (DVAs) represent the next generation of customer service automation, transforming how businesses interact with their customers. Unlike traditional Interactive Voice Response (IVR) systems, which rely on pre-defined voice menus and automated responses, DVAs utilize advanced technologies such as Artificial Intelligence (AI), machine learning, and natural language processing to engage in more dynamic, context-aware conversations. DVAs are capable of understanding complex queries, managing multi-turn dialogues, and delivering highly personalized experiences, making them essential for modern customer service environments. In contrast, traditional DVA systems, while once groundbreaking, are increasingly seen as outdated due to their limited functionality and user engagement. This paper evaluates the user experience in Dynamic Voice Assistants (DVAs) by assessing key metrics such as task completion time, success rate, and user satisfaction. It explores the unique challenges of DVA testing, focusing on critical factors like speech recognition accuracy, natural language understanding (NLU), seamless integration with telephony networks and backend systems, error handling, and system reliability, all of which directly impact user interaction. The study provides a comprehensive overview of the core components of DVAs and the specialized methodologies used to evaluate their performance from a user-centric perspective. It also discusses best practices for designing DVAs that prioritize usability, personalization, and effectiveness. Furthermore, the paper examines emerging trends, such as the integration of Artificial Intelligence (AI), which is enhancing DVAs' ability to offer more intuitive and context-aware user experiences, reshaping the landscape of modern customer service [1].

Authors

Publication Details

Published
2025-03-22
DOI
https://doi.org/10.1109/southeastcon56624.2025.10971452
Primary Topic
Technology Adoption and User Behaviour
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Quantitative Evaluation of User Experience in Digital Voice Assistant Systems: Analyzing Task Completion Time, Success Rate, and User Satisfaction

Vigneshwaran Jagadeesan Pugazhenthi, Aravindhan Murugan, Joginder Singh, Gokul Pandy et al.
Technology Adoption and User Behaviour
article

Quantitative Evaluation of User Experience in Digital Voice Assistant Systems: Analyzing Task Completion Time, Success Rate, and User Satisfaction

Vigneshwaran Jagadeesan Pugazhenthi, Aravindhan Murugan, Joginder Singh, Gokul Pandy, Baskaran Jeyarajan, Elancheran Visagan
article en

Abstract

Dynamic Voice Assistants (DVAs) represent the next generation of customer service automation, transforming how businesses interact with their customers. Unlike traditional Interactive Voice Response (IVR) systems, which rely on pre-defined voice menus and automated responses, DVAs utilize advanced technologies such as Artificial Intelligence (AI), machine learning, and natural language processing to engage in more dynamic, context-aware conversations. DVAs are capable of understanding complex queries, managing multi-turn dialogues, and delivering highly personalized experiences, making them essential for modern customer service environments. In contrast, traditional DVA systems, while once groundbreaking, are increasingly seen as outdated due to their limited functionality and user engagement. This paper evaluates the user experience in Dynamic Voice Assistants (DVAs) by assessing key metrics such as task completion time, success rate, and user satisfaction. It explores the unique challenges of DVA testing, focusing on critical factors like speech recognition accuracy, natural language understanding (NLU), seamless integration with telephony networks and backend systems, error handling, and system reliability, all of which directly impact user interaction. The study provides a comprehensive overview of the core components of DVAs and the specialized methodologies used to evaluate their performance from a user-centric perspective. It also discusses best practices for designing DVAs that prioritize usability, personalization, and effectiveness. Furthermore, the paper examines emerging trends, such as the integration of Artificial Intelligence (AI), which is enhancing DVAs' ability to offer more intuitive and context-aware user experiences, reshaping the landscape of modern customer service [1].

Openalex Percentile: Top 91%
Technology Adoption and User Behaviour
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.