Reliability-aware transfer learning with BEATs for variable-length respiratory sound classification: A patient-disjoint evaluation in two public databases

Random or central placement of respiratory sounds within padded windows can cause length-based masks to exclude recorded audio. We developed an exact support-propagation interface for the pretrained Bidirectional Encoder representation from Audio Transformers (BEATs), mapping sample support through filterbank frames and patch tokens to attention and pooling masks. We evaluated this interface alongside adaptation strategies, computational costs, probability calibration and class-conditional coverage. The study included 15,987 events from the International Conference on Biomedical and Health Informatics (ICBHI) 2017 and SPRSound databases, using patient-disjoint training, model-selection, calibration and primary test partitions at a fixed decision threshold of 0.5. The three-seed full-fine-tuning ensemble achieved average scores (AS; mean sensitivity and specificity) of 0.6619 on ICBHI (patient-cluster bootstrap 95% confidence interval, 0.6002-0.7152) and 0.9112 on SPRSound (0.8799-0.9362). Exact mapping corrected observed support exclusion and maintained finite outputs throughout placement tests; the length-based interface produced non-finite outputs in these tests and one of three matched training runs. Classification ablations showed no consistent advantage for exact mapping across the two completed seed pairs and no incremental gain from Jensen-Shannon consistency. Under matched update counts and learning-rate schedules, full fine-tuning exceeded rank-8 low-rank adaptation (LoRA) by 3.94 percentage points in AS averaged equally across databases (paired patient-cluster bootstrap 95% confidence interval, 2.54-5.40). LoRA reduced trainable parameters and recorded training time but did not reduce inference latency in the unmerged implementation. Temperature scaling improved the primary ensemble's held-out negative log-likelihood and Brier scores without uniformly improving calibration error. Entropy-based abstention achieved low accepted-set error but failed the prespecified validation requirement for adventitious-event coverage and was not applied. The integrated evaluation quantifies performance-resource trade-offs and shows that improved probability scores do not ensure adequate class-specific coverage for selective prediction. Clinical utility requires prospective validation.

Authors

Institutions

Publication Details

Journal
Medical Engineering & Physics
Published
2026-09-16
DOI
https://doi.org/10.1088/1873-4030/aea851
Primary Topic
Phonocardiography and Auscultation Techniques
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
article

Reliability-aware transfer learning with BEATs for variable-length respiratory sound classification: A patient-disjoint evaluation in two public databases

Jie Niu, Peng LI
Medical Engineering & Physics
Phonocardiography and Auscultation Techniques
article

Reliability-aware transfer learning with BEATs for variable-length respiratory sound classification: A patient-disjoint evaluation in two public databases

Jie Niu, Peng LI
article en

Abstract

Random or central placement of respiratory sounds within padded windows can cause length-based masks to exclude recorded audio. We developed an exact support-propagation interface for the pretrained Bidirectional Encoder representation from Audio Transformers (BEATs), mapping sample support through filterbank frames and patch tokens to attention and pooling masks. We evaluated this interface alongside adaptation strategies, computational costs, probability calibration and class-conditional coverage. The study included 15,987 events from the International Conference on Biomedical and Health Informatics (ICBHI) 2017 and SPRSound databases, using patient-disjoint training, model-selection, calibration and primary test partitions at a fixed decision threshold of 0.5. The three-seed full-fine-tuning ensemble achieved average scores (AS; mean sensitivity and specificity) of 0.6619 on ICBHI (patient-cluster bootstrap 95% confidence interval, 0.6002-0.7152) and 0.9112 on SPRSound (0.8799-0.9362). Exact mapping corrected observed support exclusion and maintained finite outputs throughout placement tests; the length-based interface produced non-finite outputs in these tests and one of three matched training runs. Classification ablations showed no consistent advantage for exact mapping across the two completed seed pairs and no incremental gain from Jensen-Shannon consistency. Under matched update counts and learning-rate schedules, full fine-tuning exceeded rank-8 low-rank adaptation (LoRA) by 3.94 percentage points in AS averaged equally across databases (paired patient-cluster bootstrap 95% confidence interval, 2.54-5.40). LoRA reduced trainable parameters and recorded training time but did not reduce inference latency in the unmerged implementation. Temperature scaling improved the primary ensemble's held-out negative log-likelihood and Brier scores without uniformly improving calibration error. Entropy-based abstention achieved low accepted-set error but failed the prespecified validation requirement for adventitious-event coverage and was not applied. The integrated evaluation quantifies performance-resource trade-offs and shows that improved probability scores do not ensure adequate class-specific coverage for selective prediction. Clinical utility requires prospective validation.

Medical Engineering & Physics
Nanjing University of Information Science and Technology (CN), Changzhou Institute of Technology (CN), Changzhou University (CN)
Changzhou University
Openalex Percentile: Top 12%
Phonocardiography and Auscultation Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.