Random Forest Predicts Human Ratings of Creative Stories Using Very Small Training Samples

= 0.80) using as few as 25 training stories. Furthermore, RF demonstrated superior accuracy and lower reliance on story length compared to LLM-based scoring models. These findings provide a robust proof-of-concept for using simulated expert panels as a scalable alternative to (decontextualized) automated assessment methods, while reducing human raters' burden and the logistical constraints of complex rating designs. Extension of this work to different contexts, creativity tasks and domains are necessary to gauge its generalizability.

Authors

Institutions

Publication Details

Journal
Behavioral Sciences
Published
2026-04-11
DOI
https://doi.org/10.3390/bs16040576
Primary Topic
Creativity in Education and Neuroscience
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Random Forest Predicts Human Ratings of Creative Stories Using Very Small Training Samples

Baptiste Barbot, Thomas Calogero Kiekens
Behavioral Sciences
Creativity in Education and Neuroscience
article

Random Forest Predicts Human Ratings of Creative Stories Using Very Small Training Samples

Baptiste Barbot, Thomas Calogero Kiekens
article en

Abstract

= 0.80) using as few as 25 training stories. Furthermore, RF demonstrated superior accuracy and lower reliance on story length compared to LLM-based scoring models. These findings provide a robust proof-of-concept for using simulated expert panels as a scalable alternative to (decontextualized) automated assessment methods, while reducing human raters' burden and the logistical constraints of complex rating designs. Extension of this work to different contexts, creativity tasks and domains are necessary to gauge its generalizability.

Behavioral SciencesVol. 16(4)
Yale University (US), UCLouvain (BE)
Imagination Institute
Openalex Percentile: Top 22%
Creativity in Education and Neuroscience
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.