Semantic Alignment is Not Enough: Evaluating Creativity in Iterative AI Image Generation
As Generative AI systems are increasingly used as creative partners rather than tools, aligning computational and human evaluations of creativity has become increasingly important. Using a Telephone game-inspired setup, this work examines how co-evolutionary generative processes shape semantic alignment and perceived creativity. Specifically, we used an iterative text-to-image pipeline where semantic alignment was measured using CLIPScore. We systematically varied prompt design (length and fictionality) and model variance. Human participants evaluated generated images on perceived creativity, novelty, surprise, value, and prompt fit, enabling a comparison between subjective judgments and an automated measure. CLIPScore showed a persistent decline across iterations, indicating semantic drift with diminishing changes after approximately ten iterations. While semantic alignment was a significant positive predictor of human creativity ratings, more complex prompt conditions revealed differences between automated metrics and subjective judgments. Our findings suggest that creative judgment involves more than semantic alignment, incorporating subjective interpretation and contextual information not fully captured by the computational measure. We argue that automated similarity metrics should be treated as complementary rather than proxies for creativity, and that new evaluation frameworks that integrate both subjective and computational evaluations of creativity are required to align human and machine perspectives on creative quality.
Authors
- Pei-Ying Lin (ORCID: https://orcid.org/0000-0003-0548-7949)
- H. Hofmeyer (ORCID: https://orcid.org/0000-0001-8353-7054)
- R. Schmidt (ORCID: https://orcid.org/0000-0003-2667-2473)
- Pieter Pauwels (ORCID: https://orcid.org/0000-0001-8020-4609)
- Rianne Conijn (ORCID: https://orcid.org/0000-0002-6316-4892)
Institutions
- Eindhoven University of Technology (NL)
Publication Details
- Journal
- Creativity Research Journal
- Published
- 2026-08-21
- DOI
- https://doi.org/10.1080/10400419.2026.2720462
- Primary Topic
- Creativity in Education and Neuroscience
- Type
- article
- Field-Weighted Citation Impact
- 0.00