Prediction of System Usability through Neural NetworksApplied to Conversational User Interfaces

This study investigates the use of Deep Neural Networks (DNN) to predict perceived usability in conversational user interfaces (CUIs), focusing on two systems (ChatGPT and Gemini) and two interaction modalities (text and voice). A structured methodologyinvolving data segmentation, regularization techniques, and crossvalidation was applied to develop predictive models that incorporate demographic variables and user experience. Results highlight the superior performance of the Gemini voice model (RMSE: 0.18, R2: 0.80), followed by ChatGPT in text mode (RMSE: 0.2, R2: 0.78). Text-based interaction with Gemini showed lower predictive accuracy, suggesting underfitting and the need for architectural adjustments. In general, voice-based models demonstrated greater consistency and predictive power, possibly due to a more intuitive user experience. These findings confirm the potential of DNNs to model complex user perceptions and support user-centered design. The proposed approach offers a valuable tool for anticipating usability outcomes and enhancing the personalization of CUI experiences.

Authors

Publication Details

Journal
CLEI electronic journal
Published
2026-02-12
DOI
https://doi.org/10.19153/cleiej.29.1.8
Primary Topic
Usability and User Interface Design
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Prediction of System Usability through Neural NetworksApplied to Conversational User Interfaces

H. Luna García, Cesar Alberto Collazos, Lady katherine Gomez Samboni
CLEI electronic journal
Usability and User Interface Design
article

Prediction of System Usability through Neural NetworksApplied to Conversational User Interfaces

H. Luna García, Cesar Alberto Collazos, Lady katherine Gomez Samboni
article en

Abstract

This study investigates the use of Deep Neural Networks (DNN) to predict perceived usability in conversational user interfaces (CUIs), focusing on two systems (ChatGPT and Gemini) and two interaction modalities (text and voice). A structured methodologyinvolving data segmentation, regularization techniques, and crossvalidation was applied to develop predictive models that incorporate demographic variables and user experience. Results highlight the superior performance of the Gemini voice model (RMSE: 0.18, R2: 0.80), followed by ChatGPT in text mode (RMSE: 0.2, R2: 0.78). Text-based interaction with Gemini showed lower predictive accuracy, suggesting underfitting and the need for architectural adjustments. In general, voice-based models demonstrated greater consistency and predictive power, possibly due to a more intuitive user experience. These findings confirm the potential of DNNs to model complex user perceptions and support user-centered design. The proposed approach offers a valuable tool for anticipating usability outcomes and enhancing the personalization of CUI experiences.

CLEI electronic journalVol. 29(1)
Openalex Percentile: Top 62%
Usability and User Interface Design
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.