Intrinsic-Dimension-Guided Bottleneck Selection for Variational Autoencoders with Active-Unit Diagnostics

Intrinsic-dimension (ID) estimates and active-unit diagnostics address different aspects of variational-autoencoder bottleneck selection. We evaluate search policies on four image datasets, five training seeds and five regularisation weights under explicit validation targets and common candidate costs. Holding reliability checks, fallback and reference charges fixed, ID is accepted only for 25 MNIST conditions. ID-derived and gated midpoint starts select identical widths, requesting 8.84 and 5.84 candidates on average; the other 75 conditions share an ascending fallback. In 10,000 coefficient–threshold replay evaluations, 155 local outputs miss the smallest qualifying width. A separate five-seed MNIST study adds Monte Carlo evidence-lower-bound capacity selection. Native pruning experiments distinguish full-model reconstruction, selected-axis masking, decoder adaptation and dimension transfer. On dSprites, zero-centred relevance-prior masking increases MSE by a mean seed-wise 128.6%; after equal additional decoder training, the unmasked model meets the quality target in all three seeds whereas the masked model remains 60.9% worse and fails it. Active-unit prediction establishes no additional benefit on its near-ceiling task. These bounded results separate representation geometry, which intrinsic dimension measures, from reconstruction-sufficient width, which also depends on objective, training budget and quality target, and support controlled evaluation of selection rules and diagnostics without a general efficiency or pruning guarantee.

Authors

Institutions

Publication Details

Journal
Machine Learning and Knowledge Extraction
Published
2026-09-30
DOI
https://doi.org/10.3390/make8100307
Primary Topic
Generative Adversarial Networks and Image Synthesis
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
article

Intrinsic-Dimension-Guided Bottleneck Selection for Variational Autoencoders with Active-Unit Diagnostics

Kenya Jin’no, Mizuki Dai, Chika Obata
Machine Learning and Knowledge Extraction
Generative Adversarial Networks and Image Synthesis
article

Intrinsic-Dimension-Guided Bottleneck Selection for Variational Autoencoders with Active-Unit Diagnostics

Kenya Jin’no, Mizuki Dai, Chika Obata
article en

Abstract

Intrinsic-dimension (ID) estimates and active-unit diagnostics address different aspects of variational-autoencoder bottleneck selection. We evaluate search policies on four image datasets, five training seeds and five regularisation weights under explicit validation targets and common candidate costs. Holding reliability checks, fallback and reference charges fixed, ID is accepted only for 25 MNIST conditions. ID-derived and gated midpoint starts select identical widths, requesting 8.84 and 5.84 candidates on average; the other 75 conditions share an ascending fallback. In 10,000 coefficient–threshold replay evaluations, 155 local outputs miss the smallest qualifying width. A separate five-seed MNIST study adds Monte Carlo evidence-lower-bound capacity selection. Native pruning experiments distinguish full-model reconstruction, selected-axis masking, decoder adaptation and dimension transfer. On dSprites, zero-centred relevance-prior masking increases MSE by a mean seed-wise 128.6%; after equal additional decoder training, the unmasked model meets the quality target in all three seeds whereas the masked model remains 60.9% worse and fails it. Active-unit prediction establishes no additional benefit on its near-ceiling task. These bounded results separate representation geometry, which intrinsic dimension measures, from reconstruction-sufficient width, which also depends on objective, training budget and quality target, and support controlled evaluation of selection rules and diagnostics without a general efficiency or pruning guarantee.

Machine Learning and Knowledge ExtractionVol. 8(10)
Tokyo City University (JP)
Openalex Percentile: Top 14%
Generative Adversarial Networks and Image Synthesis
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.