Exploring the creative output of six LLMs measured by Torrance’s 4 components of creative thinking based on holistic and analytic cognitive styles

As Large Language Models (LLMs) become increasingly integrated into education, understanding their impact on creativity skills is essential. Existing research has explored LLMs in creative education, and how different cognitive styles judge and process AI-generated responses. Yet, research into the personalization of LLMs in responding to cognitive styles while solving creative tasks is minimal. This study explores how well LLMs support creative education, aiming to identify the most suitable LLM for creative output that can effectively adapt to the holistic-analytic dimension of cognitive styles. Using Torrance’s four components of creativity, three student researchers independently prompted six high-traffic general-use LLMs with a control, holistic, and analytic approach to generate multiple solutions to a specific problem. Solutions were scored with a standardized 1 to 5 rubric measuring relevance, reasonability, creativity, and adaption to cognitive styles (styling). Results show all LLMs achieved nearly perfect scores for relevance and reasonability (between 4.91 and 5). Within the four aspects of creativity, Gemini achieved the greatest mean score in elaboration (4.97), Grok in flexibility (4.27), ChatGPT in fluency (3.05), and Deepseek in originality (2.96). The overall creativity score shows Copilot (2.47) and Claude (2.62) performed worse compared to the other four LLMs. Based on the overall creativity score, Grok (3.28) showed the highest scoring performance, with statistical significance compared to all other LLMs (p < 0.05). In addition, Grok significantly outperformed all other LLMs in styling (p < 0.05) except Gemini (p = 0.064). No other LLMs showed statistical significance. Future work will expand the study with the use of additional specific problems prompted to these six LLMs to better determine one specific LLM for teaching creativity based on participants' cognitive style.

Institutions

Publication Details

Journal
George Mason University
Published
2025-09-12
DOI
https://doi.org/10.13021/jssr2025.5159
Primary Topic
Various Chemistry Research Topics
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Exploring the creative output of six LLMs measured by Torrance’s 4 components of creative thinking based on holistic and analytic cognitive styles

George Mason University
Various Chemistry Research Topics
article

Exploring the creative output of six LLMs measured by Torrance’s 4 components of creative thinking based on holistic and analytic cognitive styles

article en

Abstract

As Large Language Models (LLMs) become increasingly integrated into education, understanding their impact on creativity skills is essential. Existing research has explored LLMs in creative education, and how different cognitive styles judge and process AI-generated responses. Yet, research into the personalization of LLMs in responding to cognitive styles while solving creative tasks is minimal. This study explores how well LLMs support creative education, aiming to identify the most suitable LLM for creative output that can effectively adapt to the holistic-analytic dimension of cognitive styles. Using Torrance’s four components of creativity, three student researchers independently prompted six high-traffic general-use LLMs with a control, holistic, and analytic approach to generate multiple solutions to a specific problem. Solutions were scored with a standardized 1 to 5 rubric measuring relevance, reasonability, creativity, and adaption to cognitive styles (styling). Results show all LLMs achieved nearly perfect scores for relevance and reasonability (between 4.91 and 5). Within the four aspects of creativity, Gemini achieved the greatest mean score in elaboration (4.97), Grok in flexibility (4.27), ChatGPT in fluency (3.05), and Deepseek in originality (2.96). The overall creativity score shows Copilot (2.47) and Claude (2.62) performed worse compared to the other four LLMs. Based on the overall creativity score, Grok (3.28) showed the highest scoring performance, with statistical significance compared to all other LLMs (p < 0.05). In addition, Grok significantly outperformed all other LLMs in styling (p < 0.05) except Gemini (p = 0.064). No other LLMs showed statistical significance. Future work will expand the study with the use of additional specific problems prompted to these six LLMs to better determine one specific LLM for teaching creativity based on participants' cognitive style.

George Mason University
George Mason University (US), Forsyth County Schools (US), Morristown High School (US), Montgomery High School (US), School of Visual Arts (US)
Quality Education
Openalex Percentile: Top 45%
Various Chemistry Research Topics
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.