On the Distillation of Stories for Transferring Narrative Arcs in Collections of Independent Media

The act of telling stories is a fundamental part of what it means to be human. This work introduces the concept of narrative information, which we define as the overlap in information space between a story and the items that compose the story. Using contrastive learning methods, we show how modern artificial neural networks can be leveraged to distill stories and extract a representation of the narrative information. We then demonstrate how evolutionary algorithms can leverage this to extract a set of narrative template curves and how these-in tandem with a novel curve-fitting algorithm we introduce-can reorder music albums to automatically induce stories in them. In doing so, we give statistically significant evidence that (1) these narrative information template curves are present in existing albums and that (2) people prefer an album ordered through one of these learned template curves over a random one. The premises of our work extend to any form of (largely) independent media, and as evidence, we also show that our method works with image data.

Authors

Institutions

Publication Details

Journal
IEEE Transactions on Pattern Analysis and Machine Intelligence
Published
2024-10-24
DOI
https://doi.org/10.1109/tpami.2024.3480702
Primary Topic
Video Analysis and Summarization
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

On the Distillation of Stories for Transferring Narrative Arcs in Collections of Independent Media

Dylan R. Ashley, Vincent Herrmann, Zachary Friggstad, Jürgen Schmidhuber
IEEE Transactions on Pattern Analysis and Machine Intelligence
Video Analysis and Summarization
article

On the Distillation of Stories for Transferring Narrative Arcs in Collections of Independent Media

Dylan R. Ashley, Vincent Herrmann, Zachary Friggstad, Jürgen Schmidhuber
article en

Abstract

The act of telling stories is a fundamental part of what it means to be human. This work introduces the concept of narrative information, which we define as the overlap in information space between a story and the items that compose the story. Using contrastive learning methods, we show how modern artificial neural networks can be leveraged to distill stories and extract a representation of the narrative information. We then demonstrate how evolutionary algorithms can leverage this to extract a set of narrative template curves and how these-in tandem with a novel curve-fitting algorithm we introduce-can reorder music albums to automatically induce stories in them. In doing so, we give statistically significant evidence that (1) these narrative information template curves are present in existing albums and that (2) people prefer an album ordered through one of these learned template curves over a random one. The premises of our work extend to any form of (largely) independent media, and as evidence, we also show that our method works with image data.

IEEE Transactions on Pattern Analysis and Machine IntelligenceVol. 47(2)
University of Alberta (CA), Dalle Molle Institute for Artificial Intelligence Research (CH)
Openalex Percentile: Top 82%
Video Analysis and Summarization
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

On the Distillation of Stories for Transferring Narrative Arcs in Collections of Independent Media — Dylan R. Ashley, Vincent Herrmann, et al. · IEEE Transactions on Pattern Analysis and Machine Intelligence (2024) | TGRS Research Map | TGRS