Using Generative AI to Promote Psychological, Feedback, and Artificial Intelligence Literacies in Undergraduate Psychology

Background With the arrival of generative artificial intelligence (genAI) tools, psychology educators are rethinking their assessment practices. Objective This paper describes one approach to integrating genAI into an assessment designed to promote psychological literacy. Method Students used ChatGPT to generate a media release about a published article and then wrote a critique. We evaluated whether students were able to use the marking rubric to assess the ChatGPT output, and whether working with the rubric early in the assessment process had benefits for their grades on subsequent tasks. Results The results show that students accurately assessed the ChatGPT output against the marking rubric, judging the output to be stylistically good but lacking in accurate coverage of the aims, methods, and results of the research. Working with genAI and the marking rubric early in the assessment process had benefits for performance, relative to cohorts that had engaged in peer review. Conclusion By allowing students to use genAI and scaffolding the process of critiquing and revising, students gained competencies in psychological, feedback, and AI literacies. Teaching implications Integrating genAI presents opportunities for learning, if educators can think beyond the artifact and design assessment that allows our students to showcase their learning process.

Authors

Institutions

Publication Details

Journal
Teaching of Psychology
Published
2024-10-14
DOI
https://doi.org/10.1177/00986283241287203
Citations
10
Primary Topic
Artificial Intelligence in Healthcare and Education
Type
article
Field-Weighted Citation Impact
1.20
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Using Generative AI to Promote Psychological, Feedback, and Artificial Intelligence Literacies in Undergraduate Psychology

Jenny L. Richmond, Kate Nicholls
10 citations
Teaching of Psychology
Artificial Intelligence in Healthcare and Education
1.20
article

Using Generative AI to Promote Psychological, Feedback, and Artificial Intelligence Literacies in Undergraduate Psychology

Jenny L. Richmond, Kate Nicholls
article en
10 citations

Abstract

Background With the arrival of generative artificial intelligence (genAI) tools, psychology educators are rethinking their assessment practices. Objective This paper describes one approach to integrating genAI into an assessment designed to promote psychological literacy. Method Students used ChatGPT to generate a media release about a published article and then wrote a critique. We evaluated whether students were able to use the marking rubric to assess the ChatGPT output, and whether working with the rubric early in the assessment process had benefits for their grades on subsequent tasks. Results The results show that students accurately assessed the ChatGPT output against the marking rubric, judging the output to be stylistically good but lacking in accurate coverage of the aims, methods, and results of the research. Working with genAI and the marking rubric early in the assessment process had benefits for performance, relative to cohorts that had engaged in peer review. Conclusion By allowing students to use genAI and scaffolding the process of critiquing and revising, students gained competencies in psychological, feedback, and AI literacies. Teaching implications Integrating genAI presents opportunities for learning, if educators can think beyond the artifact and design assessment that allows our students to showcase their learning process.

Teaching of PsychologyVol. 52(3)
UNSW Sydney (AU)
Quality Education
Openalex Percentile: Top 19%
Artificial Intelligence in Healthcare and Education
1.20
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.