Adaptive Dataset Pruning Based on Spatiotemporal Characteristics

Training convolutional neural networks (CNNNs) on large-scale datasets poses significant computational challenges due to redundant information inherent in numerous training samples. While dataset pruning addresses this issue by selecting representative subsets to reduce training costs, conventional approaches relying on static sample evaluations suffer from two critical limitations: (1) failure to capture the dynamic evolution of sample importance throughout the training trajectory, and (2) sensitivity to predefined pruning configurations. To overcome these shortcomings, we propose an adaptive dataset pruning framework that continuously monitors and updates sample significance during model optimization. Our methodology integrates four pivotal components: (1) a similarity prediction network that quantifies inter-class and intra-class relationships, (2) gradient-based analysis for tracking temporal variations in sample contributions, (3) dynamic selection of samples exhibiting consistent importance across training epochs, and (4) a retention mechanism for transiently critical samples. Extensive experiments on CIFAR-10 and CIFAR-100 benchmarks demonstrate that our method achieves superior performance compared to state-of-the-art baselines, particularly at moderate pruning ratios (e.g., 1.2 % accuracy improvement on CIFAR-10 with 50 % data retention). Notably, the proposed approach maintains competitive accuracy even under aggressive pruning scenarios <tex xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">$\mathbf{7 0 - 9 0 \%}$</tex> data removal), demonstrating enhanced robustness to pruning intensity variations. This work provides a principled framework for efficient deep learning through dynamic data valuation.

Authors

Institutions

Publication Details

Published
2025-06-06
DOI
https://doi.org/10.1109/dlcv65218.2025.11088493
Primary Topic
Data Mining Algorithms and Applications
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Adaptive Dataset Pruning Based on Spatiotemporal Characteristics

Wei Jie
Data Mining Algorithms and Applications
article

Adaptive Dataset Pruning Based on Spatiotemporal Characteristics

Wei Jie
article en

Abstract

Training convolutional neural networks (CNNNs) on large-scale datasets poses significant computational challenges due to redundant information inherent in numerous training samples. While dataset pruning addresses this issue by selecting representative subsets to reduce training costs, conventional approaches relying on static sample evaluations suffer from two critical limitations: (1) failure to capture the dynamic evolution of sample importance throughout the training trajectory, and (2) sensitivity to predefined pruning configurations. To overcome these shortcomings, we propose an adaptive dataset pruning framework that continuously monitors and updates sample significance during model optimization. Our methodology integrates four pivotal components: (1) a similarity prediction network that quantifies inter-class and intra-class relationships, (2) gradient-based analysis for tracking temporal variations in sample contributions, (3) dynamic selection of samples exhibiting consistent importance across training epochs, and (4) a retention mechanism for transiently critical samples. Extensive experiments on CIFAR-10 and CIFAR-100 benchmarks demonstrate that our method achieves superior performance compared to state-of-the-art baselines, particularly at moderate pruning ratios (e.g., 1.2 % accuracy improvement on CIFAR-10 with 50 % data retention). Notably, the proposed approach maintains competitive accuracy even under aggressive pruning scenarios <tex xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">$\mathbf{7 0 - 9 0 \%}$</tex> data removal), demonstrating enhanced robustness to pruning intensity variations. This work provides a principled framework for efficient deep learning through dynamic data valuation.

Chongqing University of Posts and Telecommunications (CN)
Openalex Percentile: Top 70%
Data Mining Algorithms and Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.