Quantitative Evaluation of User Experience in Digital Voice Assistant Systems: Analyzing Task Completion Time, Success Rate, and User Satisfaction
Dynamic Voice Assistants (DVAs) represent the next generation of customer service automation, transforming how businesses interact with their customers. Unlike traditional Interactive Voice Response (IVR) systems, which rely on pre-defined voice menus and automated responses, DVAs utilize advanced technologies such as Artificial Intelligence (AI), machine learning, and natural language processing to engage in more dynamic, context-aware conversations. DVAs are capable of understanding complex queries, managing multi-turn dialogues, and delivering highly personalized experiences, making them essential for modern customer service environments. In contrast, traditional DVA systems, while once groundbreaking, are increasingly seen as outdated due to their limited functionality and user engagement. This paper evaluates the user experience in Dynamic Voice Assistants (DVAs) by assessing key metrics such as task completion time, success rate, and user satisfaction. It explores the unique challenges of DVA testing, focusing on critical factors like speech recognition accuracy, natural language understanding (NLU), seamless integration with telephony networks and backend systems, error handling, and system reliability, all of which directly impact user interaction. The study provides a comprehensive overview of the core components of DVAs and the specialized methodologies used to evaluate their performance from a user-centric perspective. It also discusses best practices for designing DVAs that prioritize usability, personalization, and effectiveness. Furthermore, the paper examines emerging trends, such as the integration of Artificial Intelligence (AI), which is enhancing DVAs' ability to offer more intuitive and context-aware user experiences, reshaping the landscape of modern customer service [1].
Authors
- Vigneshwaran Jagadeesan Pugazhenthi
- Aravindhan Murugan
- Joginder Singh (ORCID: https://orcid.org/0000-0002-3211-5465)
- Gokul Pandy
- Baskaran Jeyarajan
- Elancheran Visagan
Publication Details
- Published
- 2025-03-22
- DOI
- https://doi.org/10.1109/southeastcon56624.2025.10971452
- Primary Topic
- Technology Adoption and User Behaviour
- Type
- article
- Field-Weighted Citation Impact
- 0.00