College students' credibility assessments of <scp>GenAI</scp>‐generated information for academic tasks: An interview study
Abstract The study explored college students' use of generative artificial intelligence (GenAI) tools, such as ChatGPT, for academic tasks and their perceptions and behaviors in assessing the credibility of GenAI‐generated information. Semistructured interviews were conducted with 25 college students in the United States. Interview transcripts were analyzed using the qualitative content analysis method. The study identified various types of academic tasks for which students used ChatGPT, including writing, programming, and learning. Guided by two models of credibility assessment Hilligoss and Rieh (2008); Metzger (2007), six factors influencing students' motivation and ability to assess the credibility of GenAI‐generated information were identified (e.g., task salience, social pressure). We also identified 9 constructs (e.g., refinedness, explainability), 5 heuristics (e.g., inter‐ and intrasystem consistency heuristics), and 10 cues (e.g., version and tone) used by students to assess the credibility of GenAI‐generated information. This study provides theoretical and empirical findings regarding students' use of GenAI tools in the academic context and credibility evaluation of the system outputs using rich, qualitative interview data.
Authors
- Jiaxin An (ORCID: https://orcid.org/0000-0003-2793-6469)
- Wonchan Choi (ORCID: https://orcid.org/0000-0001-6301-4969)
- Besiki Stvilia (ORCID: https://orcid.org/0000-0002-2428-6627)
- Yan Zhang (ORCID: https://orcid.org/0000-0002-1130-0012)
- Hyerin Bak (ORCID: https://orcid.org/0000-0003-3264-0240)
Institutions
- Florida State University (US)
- University of Wisconsin–Milwaukee (US)
- The University of Texas at Austin (US)
Publication Details
- Journal
- Journal of the Association for Information Science and Technology
- Published
- 2024-12-28
- DOI
- https://doi.org/10.1002/asi.24978
- Citations
- 11
- Primary Topic
- Educational Strategies and Epistemologies
- Type
- article
- Field-Weighted Citation Impact
- 8.70
Funders
- University of Wisconsin-Milwaukee