College students' credibility assessments of <scp>GenAI</scp>‐generated information for academic tasks: An interview study

Abstract The study explored college students' use of generative artificial intelligence (GenAI) tools, such as ChatGPT, for academic tasks and their perceptions and behaviors in assessing the credibility of GenAI‐generated information. Semistructured interviews were conducted with 25 college students in the United States. Interview transcripts were analyzed using the qualitative content analysis method. The study identified various types of academic tasks for which students used ChatGPT, including writing, programming, and learning. Guided by two models of credibility assessment Hilligoss and Rieh (2008); Metzger (2007), six factors influencing students' motivation and ability to assess the credibility of GenAI‐generated information were identified (e.g., task salience, social pressure). We also identified 9 constructs (e.g., refinedness, explainability), 5 heuristics (e.g., inter‐ and intrasystem consistency heuristics), and 10 cues (e.g., version and tone) used by students to assess the credibility of GenAI‐generated information. This study provides theoretical and empirical findings regarding students' use of GenAI tools in the academic context and credibility evaluation of the system outputs using rich, qualitative interview data.

Authors

Institutions

Publication Details

Journal
Journal of the Association for Information Science and Technology
Published
2024-12-28
DOI
https://doi.org/10.1002/asi.24978
Citations
11
Primary Topic
Educational Strategies and Epistemologies
Type
article
Field-Weighted Citation Impact
8.70

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

College students' credibility assessments of GenAI‐generated information for academic tasks: An interview study

Jiaxin An, Wonchan Choi, Besiki Stvilia, Yan Zhang et al.
11 citations
Journal of the Association for Information Science and Technology
Educational Strategies and Epistemologies
8.70
article

College students' credibility assessments of GenAI‐generated information for academic tasks: An interview study

Jiaxin An, Wonchan Choi, Besiki Stvilia, Yan Zhang, Hyerin Bak
article en
11 citations

Abstract

Abstract The study explored college students' use of generative artificial intelligence (GenAI) tools, such as ChatGPT, for academic tasks and their perceptions and behaviors in assessing the credibility of GenAI‐generated information. Semistructured interviews were conducted with 25 college students in the United States. Interview transcripts were analyzed using the qualitative content analysis method. The study identified various types of academic tasks for which students used ChatGPT, including writing, programming, and learning. Guided by two models of credibility assessment Hilligoss and Rieh (2008); Metzger (2007), six factors influencing students' motivation and ability to assess the credibility of GenAI‐generated information were identified (e.g., task salience, social pressure). We also identified 9 constructs (e.g., refinedness, explainability), 5 heuristics (e.g., inter‐ and intrasystem consistency heuristics), and 10 cues (e.g., version and tone) used by students to assess the credibility of GenAI‐generated information. This study provides theoretical and empirical findings regarding students' use of GenAI tools in the academic context and credibility evaluation of the system outputs using rich, qualitative interview data.

Journal of the Association for Information Science and TechnologyVol. 76(6)
Florida State University (US), University of Wisconsin–Milwaukee (US), The University of Texas at Austin (US)
University of Wisconsin-Milwaukee
Quality Education
Openalex Percentile: Top 2%
Educational Strategies and Epistemologies
8.70
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.