CodeGrade: An AI-Augmented Automated Code Grading and Mentoring Platform Integrating Multi-Dimensional Evaluation, Socratic Tutoring, and Gamified Arena Mechanics

Traditional automated code evaluation systems in Computer Science (CS) education predominantly rely on deterministic input-output string matching. While effective for assessing basic execution correctness, classical autograders fail to evaluate code readability, structural logic, algorithmic efficiency, and Big-O asymptotic complexity. Furthermore, students receive cryptic error tracebacks without pedagogical guidance, leading to reduced engagement and persistent anti-patterns. To overcome these constraints, this paper presents CodeGrade, an end-to-end AI-augmented code evaluation and mentoring platform. CodeGrade integrates a Web-based Microsoft Monaco VS Code editing engine, an isolated dual-sandbox execution environment (Judge0 containerized runner), and a Large Language Model (Groq Llama 3.3 70B) into a unified microservices architecture. The platform introduces a multi-dimensional 60/20/20 Grading Matrix that balances functional correctness (60%), AI structural logic quality (20%), and Big-O asymptotic complexity alignment (20%). Additionally, CodeGrade incorporates an AI-powered Socratic Logic Tutor enforcing strict zero-code-leakage constraints, a Monaco Line-by-Line Refactoring Diff Viewer, Web Speech API Text-to-Speech audio reviews, and a Gamified Peer-to-Peer (PvP) Battle Arena. Empirical evaluation demonstrates an average execution latency of 11 ms, high grading consistency (98.4%), and significant improvements in student engagement and code optimization quality.

Authors

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-10-16
DOI
https://doi.org/10.5281/zenodo.23412190
Primary Topic
Teaching and Learning Programming
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

CodeGrade: An AI-Augmented Automated Code Grading and Mentoring Platform Integrating Multi-Dimensional Evaluation, Socratic Tutoring, and Gamified Arena Mechanics

R C Thilak, Yeswanth G, Govindaraj Vimalraj
Zenodo (CERN European Organization for Nuclear Research)
Teaching and Learning Programming
article

CodeGrade: An AI-Augmented Automated Code Grading and Mentoring Platform Integrating Multi-Dimensional Evaluation, Socratic Tutoring, and Gamified Arena Mechanics

R C Thilak, Yeswanth G, Govindaraj Vimalraj
article en

Abstract

Traditional automated code evaluation systems in Computer Science (CS) education predominantly rely on deterministic input-output string matching. While effective for assessing basic execution correctness, classical autograders fail to evaluate code readability, structural logic, algorithmic efficiency, and Big-O asymptotic complexity. Furthermore, students receive cryptic error tracebacks without pedagogical guidance, leading to reduced engagement and persistent anti-patterns. To overcome these constraints, this paper presents CodeGrade, an end-to-end AI-augmented code evaluation and mentoring platform. CodeGrade integrates a Web-based Microsoft Monaco VS Code editing engine, an isolated dual-sandbox execution environment (Judge0 containerized runner), and a Large Language Model (Groq Llama 3.3 70B) into a unified microservices architecture. The platform introduces a multi-dimensional 60/20/20 Grading Matrix that balances functional correctness (60%), AI structural logic quality (20%), and Big-O asymptotic complexity alignment (20%). Additionally, CodeGrade incorporates an AI-powered Socratic Logic Tutor enforcing strict zero-code-leakage constraints, a Monaco Line-by-Line Refactoring Diff Viewer, Web Speech API Text-to-Speech audio reviews, and a Gamified Peer-to-Peer (PvP) Battle Arena. Empirical evaluation demonstrates an average execution latency of 11 ms, high grading consistency (98.4%), and significant improvements in student engagement and code optimization quality.

Zenodo (CERN European Organization for Nuclear Research)
Quality education
Openalex Percentile: Top 7%
Teaching and Learning Programming
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.