The Impact of Generative AI on Critical Thinking: Self-Reported Reductions in Cognitive Effort and Confidence Effects From a Survey of Knowledge Workers
The rise of Generative AI (GenAI) in knowledge workflows raises questions about its impact on critical thinking skills and practices.We survey 319 knowledge workers to investigate 1) when and how they perceive the enaction of critical thinking when using GenAI, and 2) when and why GenAI affects their effort to do so.Participants shared 936 first-hand examples of using GenAI in work tasks.Quantitatively, when considering both task-and user-specific factors, a user's task-specific self-confidence and confidence in GenAI are predictive of whether critical thinking is enacted and the effort of doing so in GenAI-assisted tasks.Specifically, higher confidence in GenAI is associated with less critical thinking, while higher self-confidence is associated with more critical thinking.Qualitatively, GenAI shifts the nature of critical thinking toward information verification, response integration, and task stewardship.Our insights reveal new design challenges and opportunities for developing GenAI tools for knowledge work.
Authors
- Ian Drosos (ORCID: https://orcid.org/0000-0003-3475-2609)
- Advait Sarkar (ORCID: https://orcid.org/0000-0002-5401-3478)
- Sean Rintel (ORCID: https://orcid.org/0000-0003-0840-0546)
- Lev Tankelevitch (ORCID: https://orcid.org/0000-0003-1286-5194)
- Hao-Ping Lee (ORCID: https://orcid.org/0000-0002-8063-1034)
- Richard Banks
- Nicholas Wilson (ORCID: https://orcid.org/0000-0001-8566-9720)
Institutions
- Microsoft Research (United Kingdom) (GB)
- Carnegie Mellon University (US)
Publication Details
- Published
- 2025-04-25
- DOI
- https://doi.org/10.1145/3706598.3713778
- Citations
- 211
- Primary Topic
- Intelligent Tutoring Systems and Adaptive Learning
- Type
- article
- Field-Weighted Citation Impact
- 523.48
Funders
- Microsoft Research