Breaking human dominance: Investigating learners' preferences for learning feedback from generative <scp>AI</scp> and human tutors

Abstract Understanding learners' preferences in educational settings is crucial for optimizing learning outcomes and experience. As artificial intelligence (AI) becomes increasingly integrated into educational contexts, it is crucial to understand learners' preferences between AI and human tutors to support their learning. While AI demonstrates growing potential in education, the phenomenon of algorithm aversion, which is a tendency to favour human decision making over algorithmic solutions, requires further investigation. To explore this issue, an experiment involving 114 university students was conducted to measure learners' preferences for different feedback sources before and after exposure to one of four conditions: no feedback, human tutor feedback, ChatGPT feedback through a free‐dialogue user interface, and AI‐powered writing analytics tool feedback through a structured interface. Our results revealed a strong initial preference for human tutors. However, the post‐task analysis showed an important nuance. While the general preference for human tutors persisted, learners' preference towards the free‐dialogue interface (ChatGPT 4.0) of ChatGPT increased, whereas the structured AI interface (AI‐powered writing analytics tool) reinforced the preference for human tutors. These findings offer theoretical and practical contributions by extending algorithm aversion theory to educational contexts and demonstrating that appropriate interaction design can mitigate this aversion. The success of free‐dialogue interfaces suggests that overcoming algorithm aversion may depend more on creating natural, flexible interaction experiences than purely technical optimization. However, we must also consider that increased preference for AI tools, particularly those with more engaging interfaces, may potentially lead to over‐reliance and metacognitive laziness among learners, highlighting the importance of balancing technological support with the development of independent learning skills. Practitioner notes What is already known about this topic? Algorithm aversion exists across various contexts where individuals tend to prefer human over algorithmic decision‐making. The introduction of generative AI brings new possibilities for AI‐supported learning. What this paper adds? In academic writing tasks, learners show strong initial preference for human tutors over Generative AI feedback. Strong initial preference for human tutors persists even after exposure to generative AI feedback. Different interaction designs lead to divergent preference patterns: Free‐dialogue interface increases preference for AI feedback, structured interface reinforces preference for human tutors. Implications for practice and/or policy Algorithm aversion in educational contexts can be mitigated through appropriate interaction design, particularly through natural dialogue interfaces. Design AI educational tools with back‐and‐forth, conversational interfaces to reduce algorithm aversion.

Authors

Institutions

Publication Details

Journal
British Journal of Educational Technology
Published
2025-07-04
DOI
https://doi.org/10.1111/bjet.13614
Citations
7
Primary Topic
Intelligent Tutoring Systems and Adaptive Learning
Type
article
Field-Weighted Citation Impact
17.37

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Breaking human dominance: Investigating learners' preferences for learning feedback from generative AI and human tutors

Yizhou Fan, Ming‐Yao Xia, Xinyu Li, Qiong Wang et al.
7 citations
British Journal of Educational Technology
Intelligent Tutoring Systems and Adaptive Learning
17.37
article

Breaking human dominance: Investigating learners' preferences for learning feedback from generative AI and human tutors

Yizhou Fan, Ming‐Yao Xia, Xinyu Li, Qiong Wang, Yüan Shen, Huixiao Le, Zijian Li, Dragan Gašević, Jiyou Jia, Luzhen Tang
article en
7 citations

Abstract

Abstract Understanding learners' preferences in educational settings is crucial for optimizing learning outcomes and experience. As artificial intelligence (AI) becomes increasingly integrated into educational contexts, it is crucial to understand learners' preferences between AI and human tutors to support their learning. While AI demonstrates growing potential in education, the phenomenon of algorithm aversion, which is a tendency to favour human decision making over algorithmic solutions, requires further investigation. To explore this issue, an experiment involving 114 university students was conducted to measure learners' preferences for different feedback sources before and after exposure to one of four conditions: no feedback, human tutor feedback, ChatGPT feedback through a free‐dialogue user interface, and AI‐powered writing analytics tool feedback through a structured interface. Our results revealed a strong initial preference for human tutors. However, the post‐task analysis showed an important nuance. While the general preference for human tutors persisted, learners' preference towards the free‐dialogue interface (ChatGPT 4.0) of ChatGPT increased, whereas the structured AI interface (AI‐powered writing analytics tool) reinforced the preference for human tutors. These findings offer theoretical and practical contributions by extending algorithm aversion theory to educational contexts and demonstrating that appropriate interaction design can mitigate this aversion. The success of free‐dialogue interfaces suggests that overcoming algorithm aversion may depend more on creating natural, flexible interaction experiences than purely technical optimization. However, we must also consider that increased preference for AI tools, particularly those with more engaging interfaces, may potentially lead to over‐reliance and metacognitive laziness among learners, highlighting the importance of balancing technological support with the development of independent learning skills. Practitioner notes What is already known about this topic? Algorithm aversion exists across various contexts where individuals tend to prefer human over algorithmic decision‐making. The introduction of generative AI brings new possibilities for AI‐supported learning. What this paper adds? In academic writing tasks, learners show strong initial preference for human tutors over Generative AI feedback. Strong initial preference for human tutors persists even after exposure to generative AI feedback. Different interaction designs lead to divergent preference patterns: Free‐dialogue interface increases preference for AI feedback, structured interface reinforces preference for human tutors. Implications for practice and/or policy Algorithm aversion in educational contexts can be mitigated through appropriate interaction design, particularly through natural dialogue interfaces. Design AI educational tools with back‐and‐forth, conversational interfaces to reduce algorithm aversion.

British Journal of Educational TechnologyVol. 56(5)
Peking University (CN), Zhejiang University of Technology (CN), Monash University (AU)
National Natural Science Foundation of China, National Office for Philosophy and Social Sciences, National Social Science Fund of China
Openalex Percentile: Top 1%
Intelligent Tutoring Systems and Adaptive Learning
17.37
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.