Random Forest Predicts Human Ratings of Creative Stories Using Very Small Training Samples
= 0.80) using as few as 25 training stories. Furthermore, RF demonstrated superior accuracy and lower reliance on story length compared to LLM-based scoring models. These findings provide a robust proof-of-concept for using simulated expert panels as a scalable alternative to (decontextualized) automated assessment methods, while reducing human raters' burden and the logistical constraints of complex rating designs. Extension of this work to different contexts, creativity tasks and domains are necessary to gauge its generalizability.
Authors
- Baptiste Barbot (ORCID: https://orcid.org/0000-0002-5096-2596)
- Thomas Calogero Kiekens
Institutions
- Yale University (US)
- UCLouvain (BE)
Publication Details
- Journal
- Behavioral Sciences
- Published
- 2026-04-11
- DOI
- https://doi.org/10.3390/bs16040576
- Primary Topic
- Creativity in Education and Neuroscience
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- Imagination Institute