Higher-order sonification of the human brain

Sonification, the process of translating data into sound, has recently gained traction as a tool for both disseminating scientific findings and enabling visually impaired individuals to analyze data. Despite its potential, most current sonification methods remain limited to one-dimensional data, primarily due to the absence of practical, quantitative, and robust techniques for handling multi-dimensional datasets. We analyze structural magnetic resonance imaging (MRI) data of the human brain by integrating two- and three-point statistical measures in Fourier space: the power spectrum and bispectrum. These quantify the spatial correlations of three-dimensional voxel intensity distributions, yielding reduced bispectra that capture higher-order interactions. To illustrate the potential of the approach, we focus on one representative reduced-bispectrum configuration (Q019036) in the OASIS-3 dataset (864 imaging sessions) and provide audio renderings for five age groups (40-50, 50-60, 60-70, 70-80, 80-100 years). As context, prior work with this configuration reported an age-prediction MAE of ≈4.2 years based on neural networks, trained on bispectrum-derived features-not through sonification itself. But here we emphasize sonification rather than predictive benchmarking. Finally, we treat these audio examples as exploratory illustrations rather than a perceptual evaluation. Our results demonstrate that the information loss (e.g., normalized mean squared error) during the reconstruction of the original bispectra, specifically in configurations sensitive to brain aging, from the sonified signal is minimal. Future studies should include systematic statistical inference and perceptual validation to assess the robustness and perceptual utility of the method. Nevertheless, the approach presented here already provides a general framework for encoding multi-dimensional data into time-series-like arrays suitable for sonification, thereby opening new avenues for scientific exploration and improving accessibility for a broader audience.

Authors

Institutions

Publication Details

Journal
Scientific Reports
Published
2025-11-27
DOI
https://doi.org/10.1038/s41598-025-26438-7
Primary Topic
Tactile and Sensory Interactions
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Higher-order sonification of the human brain

Niels Janssen, Francisco-Shu Kitaura, A. Carnero Rosell, Antonella Maselli et al.
Scientific Reports
Tactile and Sensory Interactions
article

Higher-order sonification of the human brain

Niels Janssen, Francisco-Shu Kitaura, A. Carnero Rosell, Antonella Maselli, Ernesto Pereda, Emi-Pauline Kitaura
article en

Abstract

Sonification, the process of translating data into sound, has recently gained traction as a tool for both disseminating scientific findings and enabling visually impaired individuals to analyze data. Despite its potential, most current sonification methods remain limited to one-dimensional data, primarily due to the absence of practical, quantitative, and robust techniques for handling multi-dimensional datasets. We analyze structural magnetic resonance imaging (MRI) data of the human brain by integrating two- and three-point statistical measures in Fourier space: the power spectrum and bispectrum. These quantify the spatial correlations of three-dimensional voxel intensity distributions, yielding reduced bispectra that capture higher-order interactions. To illustrate the potential of the approach, we focus on one representative reduced-bispectrum configuration (Q019036) in the OASIS-3 dataset (864 imaging sessions) and provide audio renderings for five age groups (40-50, 50-60, 60-70, 70-80, 80-100 years). As context, prior work with this configuration reported an age-prediction MAE of ≈4.2 years based on neural networks, trained on bispectrum-derived features-not through sonification itself. But here we emphasize sonification rather than predictive benchmarking. Finally, we treat these audio examples as exploratory illustrations rather than a perceptual evaluation. Our results demonstrate that the information loss (e.g., normalized mean squared error) during the reconstruction of the original bispectra, specifically in configurations sensitive to brain aging, from the sonified signal is minimal. Future studies should include systematic statistical inference and perceptual validation to assess the robustness and perceptual utility of the method. Nevertheless, the approach presented here already provides a general framework for encoding multi-dimensional data into time-series-like arrays suitable for sonification, thereby opening new avenues for scientific exploration and improving accessibility for a broader audience.

Scientific ReportsVol. 15(1)
University of Messina (IT), Universidad de La Laguna (ES), Instituto de Astrofísica de Canarias (ES)
Ministerio de Ciencia e Innovación, Cabildo de Tenerife, Agencia Estatal de Investigación
Openalex Percentile: Top 63%
Tactile and Sensory Interactions
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.