A robust adaptive meta-sample generation method for few-shot time series prediction

The research and exploration of time series prediction (TSP) have attracted much attention recently. Researchers can achieve effective TSP based on the deep learning model and a large amount of data. However, when sufficient high-quality data are not available, the performance of prediction models based on deep learning techniques may degrade. Therefore, this paper focuses on few-shot time series prediction (FTSP) and plans to combine meta-learning and generative models to alleviate the problems caused by insufficient training data. When using meta-learning techniques to process FTSP tasks, researchers set the meta-parameter in model-agnostic meta-learning (MAML) as a meta-sample and construct meta-sample generation methods based on advanced generative modeling theory to achieve better uncertainty coding. The existing meta-sample generation methods in FTSP scenes have an inherent limitation: With the increase of the complexity of prediction tasks, samples based on Gaussian distribution may be sensitive to noise and outliers in the meta-learning environment and lack of uncertainty expression, thus affecting the robustness and accuracy of prediction. Therefore, this paper proposes an adaptive sample generation method called JLSG-Diffusion. Based on the Jensen constraint framework and Laplace modeling theory, this method constructs a sample adapter with reasonable adaptive steps and fast convergence for specific tasks. The advantage is to realize fast adaptive convergence of samples to new tasks at lower cost, effectively control the overall generalization error, and improve the robustness and non-Gaussian generalization of sample posterior reasoning. Moreover, the meta sampler of JLSG-Diffusion embeds meta-learning from the implicit probability measure level of Denoising Diffusion Probabilistic Models (DDPM), which makes the meta-sample distribution directly establish a function mapping with the new task and effectively quantifies the uncertainty of spatiotemporal dimension. Experimental results on three real datasets prove the efficiency and effectiveness of JLSG-Diffusion. Compared with the benchmark methods, the prediction model combined with JLSG-Diffusion shows better accuracy.

Authors

Institutions

Publication Details

Journal
Complex & Intelligent Systems
Published
2024-12-19
DOI
https://doi.org/10.1007/s40747-024-01638-2
Primary Topic
Model Reduction and Neural Networks
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A robust adaptive meta-sample generation method for few-shot time series prediction

Defu Jiang, Kanghui Jiang, Jialin Yang, Ling‐Qiang Zhu et al.
Complex & Intelligent Systems
Model Reduction and Neural Networks
article

A robust adaptive meta-sample generation method for few-shot time series prediction

Defu Jiang, Kanghui Jiang, Jialin Yang, Ling‐Qiang Zhu, Libo Tao, Han Yan, Chao Zhang
article en

Abstract

The research and exploration of time series prediction (TSP) have attracted much attention recently. Researchers can achieve effective TSP based on the deep learning model and a large amount of data. However, when sufficient high-quality data are not available, the performance of prediction models based on deep learning techniques may degrade. Therefore, this paper focuses on few-shot time series prediction (FTSP) and plans to combine meta-learning and generative models to alleviate the problems caused by insufficient training data. When using meta-learning techniques to process FTSP tasks, researchers set the meta-parameter in model-agnostic meta-learning (MAML) as a meta-sample and construct meta-sample generation methods based on advanced generative modeling theory to achieve better uncertainty coding. The existing meta-sample generation methods in FTSP scenes have an inherent limitation: With the increase of the complexity of prediction tasks, samples based on Gaussian distribution may be sensitive to noise and outliers in the meta-learning environment and lack of uncertainty expression, thus affecting the robustness and accuracy of prediction. Therefore, this paper proposes an adaptive sample generation method called JLSG-Diffusion. Based on the Jensen constraint framework and Laplace modeling theory, this method constructs a sample adapter with reasonable adaptive steps and fast convergence for specific tasks. The advantage is to realize fast adaptive convergence of samples to new tasks at lower cost, effectively control the overall generalization error, and improve the robustness and non-Gaussian generalization of sample posterior reasoning. Moreover, the meta sampler of JLSG-Diffusion embeds meta-learning from the implicit probability measure level of Denoising Diffusion Probabilistic Models (DDPM), which makes the meta-sample distribution directly establish a function mapping with the new task and effectively quantifies the uncertainty of spatiotemporal dimension. Experimental results on three real datasets prove the efficiency and effectiveness of JLSG-Diffusion. Compared with the benchmark methods, the prediction model combined with JLSG-Diffusion shows better accuracy.

Complex & Intelligent SystemsVol. 11(1)
Hohai University (CN), PLA 306 Hospital (CN)
National Natural Science Foundation of China
Climate action
Openalex Percentile: Top 78%
Model Reduction and Neural Networks
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.