Narrative Simplification in Human and AI Retelling
Human beings have long been regarded as "homo narrans," employing storytelling to comprehend and communicate reality. This study investigates whether contemporary large language models (LLMs) can approximate the depth and richness of human narrative abilities. Through an experiment comparing retellings by humans and various state-of-the-art LLMs on a dataset of man-made short stories, we examine how word count, vocabulary complexity, and readability evolve during the retelling process. We introduce the Flesch Reading Ease score as a quantitative measure of narrative simplicity. Our findings reveal an inverse correlation between narrative condensation and increased vocabulary density in both human and LLM retellings. While both humans and LLMs tend to condense stories, their approaches differ: humans generally maintain or improve readability, whereas LLMs, without specific instructions on persona-based retellings, often reduce readability. However, with appropriate prompts, LLMs can adjust their storytelling to more closely mimic human tendencies. We also identify a unique "adaptive retelling" ability in humans, who adjust readability based on the original story’s readability. These insights advance our understanding of the "AI narrans" concept, highlighting both the current limitations and the potential of LLMs in achieving human-like storytelling capabilities.
Authors
- Yusuke Tanaka (ORCID: https://orcid.org/0000-0001-7490-2988)
- Yasuhiro Hashimoto (ORCID: https://orcid.org/0000-0002-7046-7162)
Institutions
- University of Aizu (JP)
Publication Details
- Published
- 2024-12-15
- DOI
- https://doi.org/10.1109/bigdata62323.2024.10825960
- Primary Topic
- Topic Modeling
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- New Energy and Industrial Technology Development Organization