Paint: Accurate, efficient, and sparse Model Inversion via peripheral sparsification and anchor alignment

How can we reconstruct training data from a pre-trained model without access to the original dataset? Model Inversion (MI) attempts to synthesize samples similar to the training dataset. This capability is particularly useful in data-free applications, such as data-free quantization and data-free knowledge transfer, where synthetic data replace inaccessible training samples. For these applications, MI needs to generate high-fidelity samples to preserve semantic information while remaining computationally efficient, enabling scalable generation for reliable downstream performance. However, existing MI methods fail to achieve both high fidelity and efficiency simultaneously. In this paper, we propose Paint (Peripheral sparsification and Anchor-aligned INversion Technique), an accurate, efficient, and sparse MI framework for generating high-fidelity synthetic data. Paint integrates low-pass filtering during inversion to suppress high-frequency noise, aligns salient regions toward anchor with peripheral sparsification to preserve object structures during sparse inversion, and exploits soft targets to better capture the predictive uncertainty. Extensive experiments demonstrate that Paint improves inversion efficiency for ViTs and achieves accuracy gains of up to 5.33%p in data-free scenarios.

Authors

Institutions

Publication Details

Journal
PLoS ONE
Published
2026-11-17
DOI
https://doi.org/10.1371/journal.pone.0362597
Primary Topic
Adversarial Robustness in Machine Learning
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Paint: Accurate, efficient, and sparse Model Inversion via peripheral sparsification and anchor alignment

Jaehyeon Choi, U Kang, Minjun Kim
2 links
PLoS ONE
Adversarial Robustness in Machine Learning
article

Paint: Accurate, efficient, and sparse Model Inversion via peripheral sparsification and anchor alignment

Jaehyeon Choi, U Kang, Minjun Kim
article en

Abstract

How can we reconstruct training data from a pre-trained model without access to the original dataset? Model Inversion (MI) attempts to synthesize samples similar to the training dataset. This capability is particularly useful in data-free applications, such as data-free quantization and data-free knowledge transfer, where synthetic data replace inaccessible training samples. For these applications, MI needs to generate high-fidelity samples to preserve semantic information while remaining computationally efficient, enabling scalable generation for reliable downstream performance. However, existing MI methods fail to achieve both high fidelity and efficiency simultaneously. In this paper, we propose Paint (Peripheral sparsification and Anchor-aligned INversion Technique), an accurate, efficient, and sparse MI framework for generating high-fidelity synthetic data. Paint integrates low-pass filtering during inversion to suppress high-frequency noise, aligns salient regions toward anchor with peripheral sparsification to preserve object structures during sparse inversion, and exploits soft targets to better capture the predictive uncertainty. Extensive experiments demonstrate that Paint improves inversion efficiency for ViTs and achieves accuracy gains of up to 5.33%p in data-free scenarios.

PLoS ONEVol. 21(11)
Seoul National University (KR)
Seoul National University, Ministry of Science and ICT, South Korea, Institute for Information and Communications Technology Promotion, Institute of Engineering Research, Seoul National University
Adversarial Robustness in Machine Learning
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon