Aligning Pedagogy with Generative AI: An Approach to Customizing Educational GPTs

This study presents a framework for customizing system prompts to design Generative Pre-Trained Transformers (GPTs) for teaching purposes. As GenAI tools gain traction in education, educators must understand GPT limitations and operational logic to create learning experiences that are helpful, honest, and harmless, especially as many still use default models without contextual training, risking harmful outputs. To address this, the study offers a framework that helps educators translate learning theories and objectives into structured prompts and curated knowledge bases to systematically customize GPTs. A case study illustrates its application in teaching the rhetorical goals of research communication. The customized GPT outperformed the default model across all pedagogical alignment dimensions, particularly in helpfulness and harmlessness, but remained vulnerable in honesty, especially to overgeneralization, fabrication, and bias. This study concludes with mitigation strategies to improve alignment, offering educators an accessible way to leverage their expertise and reduce risk without complex technical interventions.

Authors

Institutions

Publication Details

Journal
Proceedings of the Human Factors and Ergonomics Society Annual Meeting
Published
2025-07-13
DOI
https://doi.org/10.1177/10711813251358778
Primary Topic
Artificial Intelligence in Healthcare and Education
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Aligning Pedagogy with Generative AI: An Approach to Customizing Educational GPTs

April Tan, Elena Cotos, Michael C. Dorneich
Proceedings of the Human Factors and Ergonomics Society Annual Meeting
Artificial Intelligence in Healthcare and Education
article

Aligning Pedagogy with Generative AI: An Approach to Customizing Educational GPTs

April Tan, Elena Cotos, Michael C. Dorneich
article en

Abstract

This study presents a framework for customizing system prompts to design Generative Pre-Trained Transformers (GPTs) for teaching purposes. As GenAI tools gain traction in education, educators must understand GPT limitations and operational logic to create learning experiences that are helpful, honest, and harmless, especially as many still use default models without contextual training, risking harmful outputs. To address this, the study offers a framework that helps educators translate learning theories and objectives into structured prompts and curated knowledge bases to systematically customize GPTs. A case study illustrates its application in teaching the rhetorical goals of research communication. The customized GPT outperformed the default model across all pedagogical alignment dimensions, particularly in helpfulness and harmlessness, but remained vulnerable in honesty, especially to overgeneralization, fabrication, and bias. This study concludes with mitigation strategies to improve alignment, offering educators an accessible way to leverage their expertise and reduce risk without complex technical interventions.

Proceedings of the Human Factors and Ergonomics Society Annual MeetingVol. 69(1)
Iowa State University (US)
Openalex Percentile: Top 88%
Artificial Intelligence in Healthcare and Education
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.