An LLM-Based Guided Programming Assistance System for Code Quality Feedback and Formative Assessment

Recent advancements in Large Language Models (LLMs) hold significant promise for reshaping programming education. However, critical instructional challenges such as high failure and dropout rates, insufficient feedback, and inadequate support for students’ independent analytical thinking remain prevalent. Addressing these gaps, this study introduces the Guided Programming and Analysis System (GPAS), an innovative educational approach leveraging LLM-based technology to enhance programming instruction. GPAS is designed to support autonomous learning processes by integrating multi-turn interactive thought guidance, code polishing, semantic annotation generation, and structured scoring mechanisms across multiple programming languages. Experimental results demonstrate significant effects were observed in correlation analysis with expert evaluations (r=0.668, p=6.84×10−12) and paired-sample tests on code and report-level improvements (effect sizes Cohen’s d=0.92 and 1.56, respectively, p=3.56×10−6 and p=1.64×10−10). Additionally, findings revealed that the GPAS platform significantly improved code quality, particularly benefiting lower-achieving students, and effectively captured nuanced improvements in readability, structure, and boundary handling. Moreover, GPAS emphasizes the supportive role of educators, enabling them to focus more effectively on higher-order teaching tasks while the platform handles routine instructional feedback. Collectively, these results suggest that GPAS provides a promising framework for supporting learner-centered programming education and independent problem-solving processes.

Authors

Institutions

Publication Details

Journal
Applied Sciences
Published
2026-06-29
DOI
https://doi.org/10.3390/app16136455
Primary Topic
Teaching and Learning Programming
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

An LLM-Based Guided Programming Assistance System for Code Quality Feedback and Formative Assessment

Guoyang Liu
Applied Sciences
Teaching and Learning Programming
article

An LLM-Based Guided Programming Assistance System for Code Quality Feedback and Formative Assessment

Guoyang Liu
article en

Abstract

Recent advancements in Large Language Models (LLMs) hold significant promise for reshaping programming education. However, critical instructional challenges such as high failure and dropout rates, insufficient feedback, and inadequate support for students’ independent analytical thinking remain prevalent. Addressing these gaps, this study introduces the Guided Programming and Analysis System (GPAS), an innovative educational approach leveraging LLM-based technology to enhance programming instruction. GPAS is designed to support autonomous learning processes by integrating multi-turn interactive thought guidance, code polishing, semantic annotation generation, and structured scoring mechanisms across multiple programming languages. Experimental results demonstrate significant effects were observed in correlation analysis with expert evaluations (r=0.668, p=6.84×10−12) and paired-sample tests on code and report-level improvements (effect sizes Cohen’s d=0.92 and 1.56, respectively, p=3.56×10−6 and p=1.64×10−10). Additionally, findings revealed that the GPAS platform significantly improved code quality, particularly benefiting lower-achieving students, and effectively captured nuanced improvements in readability, structure, and boundary handling. Moreover, GPAS emphasizes the supportive role of educators, enabling them to focus more effectively on higher-order teaching tasks while the platform handles routine instructional feedback. Collectively, these results suggest that GPAS provides a promising framework for supporting learner-centered programming education and independent problem-solving processes.

Applied SciencesVol. 16(13)
Shandong University (CN)
Quality Education
Openalex Percentile: Top 4%
Teaching and Learning Programming
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.