Scaling up naturalistic narrative research: A reproducible large language model-based tool for evaluating contextual information gain

Narratives are a universal part of natural human experience. As experimental stimuli, narratives allow scientists to study complex mental processes with direct relevance to everyday experience. These analyses typically require manual labeling of key event features. Such characterization of narrative stimuli are extremely labor-intensive and prone to subjectivity. Automated tools could reduce these difficulties and enable scaling to longer, varied stimuli by exposing the exact quantities computed. We address this by introducing a metric that uses open-weight LLMs to compute contextual information gain. Our metric correlates with human ratings of event importance and causal centrality, critically distinguishing the latter from semantic centrality, thus overcoming limitations of existing automated tools. The metric similarly captures shared coactivation in the default mode network, a network implicated in narrative comprehension. Taken together, these results validate an automated, empirically-grounded tool that researchers can use to identify behaviorally- and neurally-relevant computational quantities in naturalistic stimuli.

Authors

Institutions

Publication Details

Journal
bioRxiv (Cold Spring Harbor Laboratory)
Published
2026-11-17
DOI
https://doi.org/10.64898/2026.11.14.766702
Primary Topic
Narrative Theory and Analysis
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
preprint

Scaling up naturalistic narrative research: A reproducible large language model-based tool for evaluating contextual information gain

Jungsun Yoo, Ari Khoudary, Janice Chen, Aaron M. Bornstein et al.
1 links
bioRxiv (Cold Spring Harbor Laboratory)
Narrative Theory and Analysis
preprint

Scaling up naturalistic narrative research: A reproducible large language model-based tool for evaluating contextual information gain

Jungsun Yoo, Ari Khoudary, Janice Chen, Aaron M. Bornstein, Aidan Goeschel, Rohin A Palsule
preprint en

Abstract

Narratives are a universal part of natural human experience. As experimental stimuli, narratives allow scientists to study complex mental processes with direct relevance to everyday experience. These analyses typically require manual labeling of key event features. Such characterization of narrative stimuli are extremely labor-intensive and prone to subjectivity. Automated tools could reduce these difficulties and enable scaling to longer, varied stimuli by exposing the exact quantities computed. We address this by introducing a metric that uses open-weight LLMs to compute contextual information gain. Our metric correlates with human ratings of event importance and causal centrality, critically distinguishing the latter from semantic centrality, thus overcoming limitations of existing automated tools. The metric similarly captures shared coactivation in the default mode network, a network implicated in narrative comprehension. Taken together, these results validate an automated, empirically-grounded tool that researchers can use to identify behaviorally- and neurally-relevant computational quantities in naturalistic stimuli.

bioRxiv (Cold Spring Harbor Laboratory)
Johns Hopkins University (US), Princeton University (US), University of California, Irvine (US)
Narrative Theory and Analysis
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon