The Bregman Cue-Sensitivity Map: Auditory-Scene-Analysis Cues Across Music Foundation Models

We ask which of four classical auditory-scene-analysis (ASA) cues — frequency proximity, temporal proximity, harmonicity, onset synchrony — the internal representations of released music foundation models are sensitive to, and how that depends on paradigm and scale. We define the Bregman Cue-Sensitivity Score (BCS), a rank correlation within pre-specified anchor clusters, averaged over a common relative-depth grid, between a model's representational distances and an ASA-parameterised stimulus axis, and compute it for twelve released models — self-supervised encoders, autoregressive (AR) and masked non-autoregressive (NAR) decoders, diffusion transformers (DiT) — over 8,530 rendered stimuli. Across the sampled checkpoints the result is a family-structured map rather than a simple scale ladder (S = 0.782; lineage-blocked permutation p = 0.019): encoders track frequency and onset almost fully (ρ ≥ 0.92) but stay modest on temporal proximity, whereas the larger AR decoders invert this, temporal-proximity BCS rising from 0.055 to 0.812 across the MusicGen 300M-to-3.3B ladder (Δρ = +0.757, 95% CI [0.69, 0.82], Holm p = 0.001). Two layers of front-end control then relocate the informative part of the map: frequency, harmonicity and onset are reproduced without learning, by fixed log-mel, constant-Q and gammatone transforms and by the six learned codec/VAE front-ends the models actually read, whereas temporal proximity is the one cue none of the nine reproduces (largest |ρ| of 0.136) and the one on which 7 of 9 transformers resolve above their own front-end; matched random initialisation over three seeds accounts for about a third of its rise with scale. All statements are observational and sample-scoped.

Authors

Institutions

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-08-17
DOI
https://doi.org/10.5281/zenodo.21980598
Primary Topic
Neuroscience and Music Perception
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
preprint

The Bregman Cue-Sensitivity Map: Auditory-Scene-Analysis Cues Across Music Foundation Models

Von‐Wun Soo, Guan-Yuan Chen
Zenodo (CERN European Organization for Nuclear Research)
Neuroscience and Music Perception
preprint

The Bregman Cue-Sensitivity Map: Auditory-Scene-Analysis Cues Across Music Foundation Models

Von‐Wun Soo, Guan-Yuan Chen
preprint en

Abstract

We ask which of four classical auditory-scene-analysis (ASA) cues — frequency proximity, temporal proximity, harmonicity, onset synchrony — the internal representations of released music foundation models are sensitive to, and how that depends on paradigm and scale. We define the Bregman Cue-Sensitivity Score (BCS), a rank correlation within pre-specified anchor clusters, averaged over a common relative-depth grid, between a model's representational distances and an ASA-parameterised stimulus axis, and compute it for twelve released models — self-supervised encoders, autoregressive (AR) and masked non-autoregressive (NAR) decoders, diffusion transformers (DiT) — over 8,530 rendered stimuli. Across the sampled checkpoints the result is a family-structured map rather than a simple scale ladder (S = 0.782; lineage-blocked permutation p = 0.019): encoders track frequency and onset almost fully (ρ ≥ 0.92) but stay modest on temporal proximity, whereas the larger AR decoders invert this, temporal-proximity BCS rising from 0.055 to 0.812 across the MusicGen 300M-to-3.3B ladder (Δρ = +0.757, 95% CI [0.69, 0.82], Holm p = 0.001). Two layers of front-end control then relocate the informative part of the map: frequency, harmonicity and onset are reproduced without learning, by fixed log-mel, constant-Q and gammatone transforms and by the six learned codec/VAE front-ends the models actually read, whereas temporal proximity is the one cue none of the nine reproduces (largest |ρ| of 0.136) and the one on which 7 of 9 transformers resolve above their own front-end; matched random initialisation over three seeds accounts for about a third of its rise with scale. All statements are observational and sample-scoped.

Zenodo (CERN European Organization for Nuclear Research)
Chang Gung University (TW), National Tsing Hua University (TW), North Carolina Exploring Cultural Heritage Online (US)
Neuroscience and Music Perception
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

The Bregman Cue-Sensitivity Map: Auditory-Scene-Analysis Cues Across Music Foundation Models — Von‐Wun Soo, Guan-Yuan Chen · Zenodo (CERN European Organization for Nuclear Research) (2026) | TGRS Research Map | TGRS