Re(de)fining Sonification: Project Classification Strategies in the Data Sonification Archive

This study focuses on a corpus of 445 sonification projects currently available in the Data Sonification Archive (DSA). The DSA develops in a collaborative process that involves researchers and creative communities, and has been online since early 2021. Projects are heuristically classified according to several aspects, in particular their intended purpose, targeted users, subject matter, sonification method, and combination of media. In the present study, we analyse six curatorial classification strategies, labelled <i>Goal</i>, <i>Method</i>, <i>User,</i> <i>Macro Topic</i>, <i>Micro Topic</i>, and <i>MediaMix</i>, and discuss their definitions and usefulness for the archive. We then introduce two computational classification strategies, respectively based on clustering of music information retrieval of sonification audio, and topic modelling of the descriptive texts that accompany DSA projects. Correlation analysis between curatorial and computational classifications, correspondingly sized, showed that the text-based method was more powerful than the audio-based methods. We then explored predictive modelling, tentatively achieving results for <i>Goal, Method, and Macro Topic</i>. This points towards the potential for automatic classification to assist in the curatorial management of the archive, as well as for similar repositories. The discussion focuses on how analysis of classification strategies supports a broadening of the definition of sonification, both as theoretical construct and as practice, where the communicative intention of the author, the aesthetic quality of the listening experience, a more explicit focus on narrative patterns, and other emerging aspects within sonification design, are all contributing factors to transitioning the field towards a mass medium for data representation, communication, and meaning-making.

Authors

Publication Details

Journal
Journal of the Audio Engineering Society
Published
2024-09-17
DOI
https://doi.org/10.17743/jaes.2022.0167
Citations
2
Primary Topic
BIM and Construction Integration
Type
article
Field-Weighted Citation Impact
0.53
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Re(de)fining Sonification: Project Classification Strategies in the Data Sonification Archive

Valentina Caiola, Paolo Ciuccarelli, Sara Lenzi, Manni Chen et al.
2 citations
Journal of the Audio Engineering Society
BIM and Construction Integration
0.53
article

Re(de)fining Sonification: Project Classification Strategies in the Data Sonification Archive

Valentina Caiola, Paolo Ciuccarelli, Sara Lenzi, Manni Chen, PerMagnus Lindborg
article en
2 citations

Abstract

This study focuses on a corpus of 445 sonification projects currently available in the Data Sonification Archive (DSA). The DSA develops in a collaborative process that involves researchers and creative communities, and has been online since early 2021. Projects are heuristically classified according to several aspects, in particular their intended purpose, targeted users, subject matter, sonification method, and combination of media. In the present study, we analyse six curatorial classification strategies, labelled <i>Goal</i>, <i>Method</i>, <i>User,</i> <i>Macro Topic</i>, <i>Micro Topic</i>, and <i>MediaMix</i>, and discuss their definitions and usefulness for the archive. We then introduce two computational classification strategies, respectively based on clustering of music information retrieval of sonification audio, and topic modelling of the descriptive texts that accompany DSA projects. Correlation analysis between curatorial and computational classifications, correspondingly sized, showed that the text-based method was more powerful than the audio-based methods. We then explored predictive modelling, tentatively achieving results for <i>Goal, Method, and Macro Topic</i>. This points towards the potential for automatic classification to assist in the curatorial management of the archive, as well as for similar repositories. The discussion focuses on how analysis of classification strategies supports a broadening of the definition of sonification, both as theoretical construct and as practice, where the communicative intention of the author, the aesthetic quality of the listening experience, a more explicit focus on narrative patterns, and other emerging aspects within sonification design, are all contributing factors to transitioning the field towards a mass medium for data representation, communication, and meaning-making.

Journal of the Audio Engineering SocietyVol. 72(9)
Climate action
Openalex Percentile: Top 35%
BIM and Construction Integration
0.53
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.