Meta-learning approach for variational autoencoder hyperparameter tuning

Synthetic data generation is a promising alternative to traditional data anonymization, with Variational Autoencoders (VAEs) excelling at generating high-quality synthetic tabular datasets. However, VAE hyperparameter selection is often computationally expensive or subop-timal. We propose a meta-learning (MtL) method for hyperparameter recommendation, which achieves competitive performance to state-of-the-art Bayesian Optimization (BO) with median AUC values of 0.660 ± 0.038 (MtL) and 0.650 ± 0.041 (BO), showing no statistically significant difference. Notably, our approach reduces configuration time to under three minutes, compared to BO’s multi-hour requirement, while also enabling incremental improvements through new data integration. This combination of efficiency, adaptability, and performance establishes MtL as a practical solution for hyperparameter tuning in synthetic data generation.

Authors

Institutions

Publication Details

Journal
ZooKeys
Published
2025-01-01
DOI
https://doi.org/10.3897/jucs.124087
Primary Topic
Machine Learning and Data Classification
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Meta-learning approach for variational autoencoder hyperparameter tuning

Sylvio Barbon, Sebastiano Saccani, Matheus Camilo da Silva, Michele Berti
ZooKeys
Machine Learning and Data Classification
article

Meta-learning approach for variational autoencoder hyperparameter tuning

Sylvio Barbon, Sebastiano Saccani, Matheus Camilo da Silva, Michele Berti
article en

Abstract

Synthetic data generation is a promising alternative to traditional data anonymization, with Variational Autoencoders (VAEs) excelling at generating high-quality synthetic tabular datasets. However, VAE hyperparameter selection is often computationally expensive or subop-timal. We propose a meta-learning (MtL) method for hyperparameter recommendation, which achieves competitive performance to state-of-the-art Bayesian Optimization (BO) with median AUC values of 0.660 ± 0.038 (MtL) and 0.650 ± 0.041 (BO), showing no statistically significant difference. Notably, our approach reduces configuration time to under three minutes, compared to BO’s multi-hour requirement, while also enabling incremental improvements through new data integration. This combination of efficiency, adaptability, and performance establishes MtL as a practical solution for hyperparameter tuning in synthetic data generation.

ZooKeys
University of Trieste (IT)
Industry, innovation and infrastructure
Openalex Percentile: Top 93%
Machine Learning and Data Classification
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.