AI-Powered Conversational Interfaces in Higher Education: An Experimental Comparison of Chatbots and Traditional Websites for Information Seeking
As artificial intelligence (AI) continues to reshape higher education, traditional web-based methods of providing interested parties with academic and institutional information are increasingly being challenged. The current study provides empirical evidence surrounding young adult perceptions, information-seeking efficiency, and objective task performance when using AI-powered chatbots compared to traditional university websites. Guided by the Technology Readiness and Acceptance Model (TRAM), 299 participants were randomly assigned to complete information-seeking tasks using a traditional university website or an AI-powered chatbot. Following random assignment, participants using the AI-powered chatbot reported significantly greater perceived ease of use (p < 0.001), perceived usefulness (p < 0.001), and more favorable attitudes toward the technology (p < 0.001) than participants using the traditional website. Beyond these perceptual differences, participants using the chatbot completed the information-seeking tasks in approximately 38% less time and demonstrated overall task accuracy of 95.6%, compared with 78.5% for website participants, an increase of 17.1 percentage points. AI-powered conversational interfaces appear capable of improving not only perceptions of the information-seeking experience, but also the speed and accuracy with which institutional information can be located. Thus, higher education institutions are advised to consider conversational AI as a complementary support infrastructure while continuing to systematically evaluate both user perceptions and objective performance outcomes.
Authors
- Chad Goebert (ORCID: https://orcid.org/0000-0002-8105-534X)
- Kyu-soo Chung (ORCID: https://orcid.org/0000-0001-9690-0641)
- John David Johnson
Institutions
- Kennesaw State University (US)
Publication Details
- Journal
- Education Sciences
- Published
- 2026-11-17
- DOI
- https://doi.org/10.3390/educsci16111966
- Primary Topic
- AI in Service Interactions
- Type
- article
- Field-Weighted Citation Impact
- 0.00