Exploring Automated Assessment of Primary Students’ Creativity in a Flow-Based Music Programming Environment

Creativity is a vital skill in science, technology, engineering, and mathematics (STEM)--related education, fostering innovation and problem-solving. Traditionally, creativity assessments relied on human evaluations, such as the consensual assessment technique (CAT), which are resource-intensive, time-consuming, and often subjective. Recent advances in computational methods, particularly large language models (LLMs), have enabled automated creativity assessments. In this study, we extend research on automated creativity scoring to a flow-based music programming environment, a context that integrates computational and creative thinking. We collected 383 programming artifacts from 194 primary school students (2022--2024) and employed two automated approaches: an evidence-centred design (ECD) framework--based approach and an LLM-based approach using ChatGPT-4 with few-shot learning. The ECD-based approach integrates divergent thinking, complexity, efficiency, and emotional expressiveness, while the LLM-based approach uses CAT ratings and ECD examples to learn creativity scoring. Results revealed moderate to strong correlations with human evaluations (ECD-based: \( r = 0.48 \); LLM-based: \( r = 0.68 \)), with the LLM-based approach demonstrating greater consistency across varying learning examples (\( r = 0.82 \)). These findings highlight the potential of automated tools for scalable, objective, and efficient creativity assessment, paving the way for their application in creativity-focused learning environments.

Authors

Institutions

Publication Details

Journal
Journal of Learning Analytics
Published
2025-08-29
DOI
https://doi.org/10.18608/jla.2025.8835
Citations
1
Primary Topic
Flow Experience in Various Fields
Type
article
Field-Weighted Citation Impact
3.44

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Exploring Automated Assessment of Primary Students’ Creativity in a Flow-Based Music Programming Environment

Chenglu Li, Zifeng Liu, Wanli Xing, Hai Li et al.
1 citations
Journal of Learning Analytics
Flow Experience in Various Fields
3.44
article

Exploring Automated Assessment of Primary Students’ Creativity in a Flow-Based Music Programming Environment

Chenglu Li, Zifeng Liu, Wanli Xing, Hai Li, Fan Zhang, Victor Minces
article en
1 citations

Abstract

Creativity is a vital skill in science, technology, engineering, and mathematics (STEM)--related education, fostering innovation and problem-solving. Traditionally, creativity assessments relied on human evaluations, such as the consensual assessment technique (CAT), which are resource-intensive, time-consuming, and often subjective. Recent advances in computational methods, particularly large language models (LLMs), have enabled automated creativity assessments. In this study, we extend research on automated creativity scoring to a flow-based music programming environment, a context that integrates computational and creative thinking. We collected 383 programming artifacts from 194 primary school students (2022--2024) and employed two automated approaches: an evidence-centred design (ECD) framework--based approach and an LLM-based approach using ChatGPT-4 with few-shot learning. The ECD-based approach integrates divergent thinking, complexity, efficiency, and emotional expressiveness, while the LLM-based approach uses CAT ratings and ECD examples to learn creativity scoring. Results revealed moderate to strong correlations with human evaluations (ECD-based: \( r = 0.48 \); LLM-based: \( r = 0.68 \)), with the LLM-based approach demonstrating greater consistency across varying learning examples (\( r = 0.82 \)). These findings highlight the potential of automated tools for scalable, objective, and efficient creativity assessment, paving the way for their application in creativity-focused learning environments.

Journal of Learning AnalyticsVol. 12(2)
University of Utah (US), University of Florida (US), University of California San Diego (US)
National Science Foundation
Openalex Percentile: Top 8%
Flow Experience in Various Fields
3.44
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.