Ablation study: Calibrated adaptive learning ensemble methodology

We conduct a systematic ablation study of the Calibrated Adaptive Learning via Mutual-Ensemble Fusion (CALM) framework to determine how teacher ensemble size influences student accuracy, calibration and computational cost. Using ensembles of two to five teachers drawn from diverse convolutional architectures, we evaluate performance on CIFAR-10 under four CALM configurations. Our results show that calibration-aware training (CAL) yields the lowest expected calibration error while adaptive curriculum pacing (ACP) delivers exceptional calibration in small ensembles. The full ACP CAL setup achieves peak accuracy but introduces a trade-off with calibration quality. We observe diminishing returns beyond three teachers and identify optimal configurations that balance accuracy, uncertainty estimation and resource usage. These insights inform practical guidelines for deploying multi-teacher distillation in environments where model confidence and efficiency are critical.

Authors

Institutions

Publication Details

Journal
Procedia Computer Science
Published
2025-01-01
DOI
https://doi.org/10.1016/j.procs.2025.09.041
Primary Topic
Adversarial Robustness in Machine Learning
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Ablation study: Calibrated adaptive learning ensemble methodology

Indra Dharma Wijaya, Gabriel Asael Tarigan, Gading Aditya Perdana, Kevin Ahmad Fahreza
Procedia Computer Science
Adversarial Robustness in Machine Learning
article

Ablation study: Calibrated adaptive learning ensemble methodology

Indra Dharma Wijaya, Gabriel Asael Tarigan, Gading Aditya Perdana, Kevin Ahmad Fahreza
article en

Abstract

We conduct a systematic ablation study of the Calibrated Adaptive Learning via Mutual-Ensemble Fusion (CALM) framework to determine how teacher ensemble size influences student accuracy, calibration and computational cost. Using ensembles of two to five teachers drawn from diverse convolutional architectures, we evaluate performance on CIFAR-10 under four CALM configurations. Our results show that calibration-aware training (CAL) yields the lowest expected calibration error while adaptive curriculum pacing (ACP) delivers exceptional calibration in small ensembles. The full ACP CAL setup achieves peak accuracy but introduces a trade-off with calibration quality. We observe diminishing returns beyond three teachers and identify optimal configurations that balance accuracy, uncertainty estimation and resource usage. These insights inform practical guidelines for deploying multi-teacher distillation in environments where model confidence and efficiency are critical.

Procedia Computer ScienceVol. 269
Binus University (ID)
Openalex Percentile: Top 83%
Adversarial Robustness in Machine Learning
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.