From Search to Dialogue: An Experimental Comparison of User Experience, Satisfaction and Success with ChatGPT and Google

Generative Artificial Intelligence (GenAI) is increasingly shaping informal learning in everyday life, with tools like ChatGPT becoming part of many individuals’ daily routines. While prior research has focused primarily on student learning, the role of GenAI in adult everyday information-seeking remains underexplored. This study examines how GenAI influences user experience, learning satisfaction, and learning outcomes in informal contexts. In a randomized online experiment (N = 120), participants completed learning tasks using both ChatGPT and Google. Results show that ChatGPT significantly improves user experience and learning satisfaction compared to traditional search engines. Additionally, self-efficacy positively impacts learning satisfaction, and both user experience and satisfaction are associated with fewer unknown responses—leading to higher quiz scores and better learning outcomes. These findings underscore the value of conversational GenAI in enhancing informal learning, highlighting its potential to support more effective, satisfying, and self-directed digital knowledge acquisition.

Authors

Publication Details

Journal
TUbilio (Technical University of Darmstadt)
Published
2025-12-23
Primary Topic
AI in Service Interactions
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

From Search to Dialogue: An Experimental Comparison of User Experience, Satisfaction and Success with ChatGPT and Google

Peter Buxmann, Danilo Walenta, Anna Schätzle, Maren Mehler
TUbilio (Technical University of Darmstadt)
AI in Service Interactions
article

From Search to Dialogue: An Experimental Comparison of User Experience, Satisfaction and Success with ChatGPT and Google

Peter Buxmann, Danilo Walenta, Anna Schätzle, Maren Mehler
article en

Abstract

Generative Artificial Intelligence (GenAI) is increasingly shaping informal learning in everyday life, with tools like ChatGPT becoming part of many individuals’ daily routines. While prior research has focused primarily on student learning, the role of GenAI in adult everyday information-seeking remains underexplored. This study examines how GenAI influences user experience, learning satisfaction, and learning outcomes in informal contexts. In a randomized online experiment (N = 120), participants completed learning tasks using both ChatGPT and Google. Results show that ChatGPT significantly improves user experience and learning satisfaction compared to traditional search engines. Additionally, self-efficacy positively impacts learning satisfaction, and both user experience and satisfaction are associated with fewer unknown responses—leading to higher quiz scores and better learning outcomes. These findings underscore the value of conversational GenAI in enhancing informal learning, highlighting its potential to support more effective, satisfying, and self-directed digital knowledge acquisition.

TUbilio (Technical University of Darmstadt)
Quality Education
Openalex Percentile: Top 18%
AI in Service Interactions
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.