Can Artificial Intelligence Write Like Borges? An Evaluation Protocol for Spanish Microfiction
Automated story writing has been a subject of study for over 60 years. Today, large language models can generate narratively consistent and linguistically coherent short fiction texts. Despite these advancements, rigorous assessment of such outputs in terms of literary merit—especially concerning aesthetic qualities—has received scant attention. In this paper, we address the challenge of evaluating AI-generated microfiction (MF) and argue that this task requires consideration of literary criteria across various aspects of the text, including thematic coherence, textual clarity, interpretive depth, and aesthetic quality. To facilitate this, we present GrAImes: an evaluation protocol grounded in literary theory; specifically, GrAImes draws from a literary perspective to offer an objective framework for assessing AI-generated microfiction. Furthermore, we report the results of our validation of the evaluation protocol as answered by both literature experts and literary enthusiasts. This protocol will serve as a foundation for evaluating automatically generated microfiction and assessing its literary value.
Authors
- Jorge García Flores (ORCID: https://orcid.org/0000-0002-6074-0938)
- Raúl Monroy (ORCID: https://orcid.org/0000-0002-3465-995X)
- Nathalie Pernelle (ORCID: https://orcid.org/0000-0003-1487-393X)
- Yobany de José García Medina (ORCID: https://orcid.org/0000-0002-6094-9395)
- Gerardo Aleman Manzanarez (ORCID: https://orcid.org/0000-0003-4174-8771)
- Nora de la Cruz Arana
Institutions
- Sorbonne Université (FR)
- Université Sorbonne Paris Nord (FR)
- Laboratoire d'Informatique de Paris-Nord (FR)
- Tecnológico de Monterrey (MX)
Publication Details
- Journal
- Applied Sciences
- Published
- 2025-06-17
- DOI
- https://doi.org/10.3390/app15126802
- Citations
- 1
- Primary Topic
- Digital Humanities and Scholarship
- Type
- article
- Field-Weighted Citation Impact
- 15.18