Measuring Narrative Visualizations: A Model-Based Evaluation Framework and Validation

Evaluating narrative visualizations is complex due to their dependence on user characteristics, context, and storytelling elements. This study presents NaVi-Q, a quality model designed to structure the assessment of narrative visualizations, drawing on principles from Software Engineering and Information Visualization. The model was tested in an experiment where 40 participants evaluated 30 visualizations. The results suggest that the model’s criteria align with expert assessments in distinguishing different quality levels. Scores from experts and non-experts followed similar patterns, indicating that the model may be applicable across different levels of experience. These findings suggest that NaVi-Q can be used as a reference for structuring the evaluation of narrative visualizations in research and practice.

Authors

Institutions

Publication Details

Journal
IEEE Access
Published
2025-01-01
DOI
https://doi.org/10.1109/access.2025.3570485
Primary Topic
Digital Storytelling and Education
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Measuring Narrative Visualizations: A Model-Based Evaluation Framework and Validation

Juan Andrés Carruthers, Andrés Diaz-Pace, Andrea Lezcano Airaldi, Emanuel Irrazábal
IEEE Access
Digital Storytelling and Education
article

Measuring Narrative Visualizations: A Model-Based Evaluation Framework and Validation

Juan Andrés Carruthers, Andrés Diaz-Pace, Andrea Lezcano Airaldi, Emanuel Irrazábal
article en

Abstract

Evaluating narrative visualizations is complex due to their dependence on user characteristics, context, and storytelling elements. This study presents NaVi-Q, a quality model designed to structure the assessment of narrative visualizations, drawing on principles from Software Engineering and Information Visualization. The model was tested in an experiment where 40 participants evaluated 30 visualizations. The results suggest that the model’s criteria align with expert assessments in distinguishing different quality levels. Scores from experts and non-experts followed similar patterns, indicating that the model may be applicable across different levels of experience. These findings suggest that NaVi-Q can be used as a reference for structuring the evaluation of narrative visualizations in research and practice.

IEEE AccessVol. 13
Universidad Nacional del Centro de la Provincia de Buenos Aires (AR), Centro Científico Tecnológico - Tandil (AR)
Consejo Nacional de Investigaciones Científicas y Técnicas, Secretaría General de Ciencia y Técnica, Universidad Nacional del Nordeste
Openalex Percentile: Top 86%
Digital Storytelling and Education
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.