WIP: A Pedagogical Prompt Engineering Framework for LLM-Based Feedback in Higher Education (PPE-LLM)

This Work-in-Progress (WIP) paper introduces PPE-LLM, a structured framework for prompt engineering that enables LLM -generated feedback to be pedagogically meaningful and tailored to novice programming students in introductory pro-gramming education. Although large language models (LLMs) show promise for feedback generation, existing research lacks a structured methodology that integrates pedagogical principles, student needs, best-practice prompting, and technical consid-erations. PPE- LLM addresses this gap by providing a theory-driven framework that supports the systematic design of prompts to generate formative feedback, enhancing learning tailored to students' learning levels and needs. This paper presents the key components of the framework, along with a practical example prompt. It also analyses the alignment of recent CER studies with the PPE- LLM components. The results indicate that studies with limited alignment often produced inconsistent or lower-quality feedback, whereas more substantial alignment was found to be pedagogically effective in AI-generated feedback. Future work includes expert validation and student evaluation in real-world settings.

Authors

Institutions

Publication Details

Published
2025-11-02
DOI
https://doi.org/10.1109/fie63693.2025.11328552
Primary Topic
Intelligent Tutoring Systems and Adaptive Learning
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

WIP: A Pedagogical Prompt Engineering Framework for LLM-Based Feedback in Higher Education (PPE-LLM)

Mireilla Bikanga Ada, Jake Lever, Eyman Alyahyan
Intelligent Tutoring Systems and Adaptive Learning
article

WIP: A Pedagogical Prompt Engineering Framework for LLM-Based Feedback in Higher Education (PPE-LLM)

Mireilla Bikanga Ada, Jake Lever, Eyman Alyahyan
article en

Abstract

This Work-in-Progress (WIP) paper introduces PPE-LLM, a structured framework for prompt engineering that enables LLM -generated feedback to be pedagogically meaningful and tailored to novice programming students in introductory pro-gramming education. Although large language models (LLMs) show promise for feedback generation, existing research lacks a structured methodology that integrates pedagogical principles, student needs, best-practice prompting, and technical consid-erations. PPE- LLM addresses this gap by providing a theory-driven framework that supports the systematic design of prompts to generate formative feedback, enhancing learning tailored to students' learning levels and needs. This paper presents the key components of the framework, along with a practical example prompt. It also analyses the alignment of recent CER studies with the PPE- LLM components. The results indicate that studies with limited alignment often produced inconsistent or lower-quality feedback, whereas more substantial alignment was found to be pedagogically effective in AI-generated feedback. Future work includes expert validation and student evaluation in real-world settings.

University of Glasgow (GB)
Quality Education
Openalex Percentile: Top 17%
Intelligent Tutoring Systems and Adaptive Learning
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

WIP: A Pedagogical Prompt Engineering Framework for LLM-Based Feedback in Higher Education (PPE-LLM) — Mireilla Bikanga Ada, Jake Lever, et al. · (2025) | TGRS Research Map | TGRS