Class-Conditional Regret Offsets for Budgeted Early Exits: A Multi-Seed Pilot on Handwritten Digits

Early-exit networks can reduce conditional inference work by replacing a subset of full-depth predictions with shallow classifier outputs. This exploratory preprint examines a calibration-only, class-conditional correction based on estimated regret when shallow and final predictions disagree. Using a two-exit PyTorch multilayer perceptron and 12 stratified splits of the 1,797-example scikit-learn handwritten-digits benchmark, we evaluate clean and synthetic-corruption scenarios under three levels of class imbalance, with confidence and margin early-exit baselines. On clean balanced data at a 60% calibration exit target, the examined route attains 96.55% mean classification accuracy and reduces estimated dense-layer multiply-accumulates by 43.72% relative to full-depth execution of the same two-head network, or 41.68% relative to a final-head-only backbone. Standard confidence routing achieves comparable results. One synthetic noise/imbalance setting shows a modest condition-specific advantage, but the explored correction does not consistently improve accuracy or class-level performance. We report all results and runnable source, including the limitations of a small dataset and operation-count rather than wall-clock evaluation. This is a non-peer-reviewed exploratory research note, not a claim of state-of-the-art performance. Generative AI assisted with research prototyping, implementation, analysis, and manuscript drafting.

Authors

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-10-15
DOI
https://doi.org/10.5281/zenodo.23392805
Primary Topic
Advanced Neural Network Applications
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
preprint

Class-Conditional Regret Offsets for Budgeted Early Exits: A Multi-Seed Pilot on Handwritten Digits

Moses Oumo
Zenodo (CERN European Organization for Nuclear Research)
Advanced Neural Network Applications
preprint

Class-Conditional Regret Offsets for Budgeted Early Exits: A Multi-Seed Pilot on Handwritten Digits

Moses Oumo
preprint en

Abstract

Early-exit networks can reduce conditional inference work by replacing a subset of full-depth predictions with shallow classifier outputs. This exploratory preprint examines a calibration-only, class-conditional correction based on estimated regret when shallow and final predictions disagree. Using a two-exit PyTorch multilayer perceptron and 12 stratified splits of the 1,797-example scikit-learn handwritten-digits benchmark, we evaluate clean and synthetic-corruption scenarios under three levels of class imbalance, with confidence and margin early-exit baselines. On clean balanced data at a 60% calibration exit target, the examined route attains 96.55% mean classification accuracy and reduces estimated dense-layer multiply-accumulates by 43.72% relative to full-depth execution of the same two-head network, or 41.68% relative to a final-head-only backbone. Standard confidence routing achieves comparable results. One synthetic noise/imbalance setting shows a modest condition-specific advantage, but the explored correction does not consistently improve accuracy or class-level performance. We report all results and runnable source, including the limitations of a small dataset and operation-count rather than wall-clock evaluation. This is a non-peer-reviewed exploratory research note, not a claim of state-of-the-art performance. Generative AI assisted with research prototyping, implementation, analysis, and manuscript drafting.

Zenodo (CERN European Organization for Nuclear Research)
Advanced Neural Network Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.