A Feature Enhancement Framework Based on Pre-trained Foundation Models for Time-series Forecasting in EIoT

With the advancement of the energy internet of things (EIoT), accurate predictive data in industrial power systems (IPS) has become crucial for fault detection, energy management and system optimization. In recent years, TimeSeries Pre-trained Foundation Models (TSPFMs) have demonstrated considerable potential in this application. However, their predictive performance remains constrained when confronted with domain-specific data with high noise, multi-periodic, and complex features. To improve the forecasting ability of TSPFMs, we propose a novel framework that merges a Frequency Enhanced Module (FEM) and a high-dimensional Temporal Position Attention (TPA) mechanism for feature enhancement. To be specific, the FEM processes multi-channel data in the frequency domain, effectively capturing feature independencies. The TPA generates channel-specific attention maps, thereby integrating a broader range of contextual information into local features. Additionally, we introduce a dynamic loss function that adjusts penalties according to the forecasting step size, thereby optimizing the long-term prediction performance. By performing experiments on multiple IPS datasets, the results indicate that the optimized model achieves a $12.50 \%$ to $16.82 \%$ improvement in prediction accuracy, demonstrating enhanced robustness and accuracy across various prediction lengths.

Authors

Institutions

Publication Details

Published
2025-08-10
DOI
https://doi.org/10.1109/iccc65529.2025.11148816
Primary Topic
Time Series Analysis and Forecasting
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A Feature Enhancement Framework Based on Pre-trained Foundation Models for Time-series Forecasting in EIoT

Pengcheng Xia, Yiyang Ni, Yiqun Guo, Jun Li
Time Series Analysis and Forecasting
article

A Feature Enhancement Framework Based on Pre-trained Foundation Models for Time-series Forecasting in EIoT

Pengcheng Xia, Yiyang Ni, Yiqun Guo, Jun Li
article en

Abstract

With the advancement of the energy internet of things (EIoT), accurate predictive data in industrial power systems (IPS) has become crucial for fault detection, energy management and system optimization. In recent years, TimeSeries Pre-trained Foundation Models (TSPFMs) have demonstrated considerable potential in this application. However, their predictive performance remains constrained when confronted with domain-specific data with high noise, multi-periodic, and complex features. To improve the forecasting ability of TSPFMs, we propose a novel framework that merges a Frequency Enhanced Module (FEM) and a high-dimensional Temporal Position Attention (TPA) mechanism for feature enhancement. To be specific, the FEM processes multi-channel data in the frequency domain, effectively capturing feature independencies. The TPA generates channel-specific attention maps, thereby integrating a broader range of contextual information into local features. Additionally, we introduce a dynamic loss function that adjusts penalties according to the forecasting step size, thereby optimizing the long-term prediction performance. By performing experiments on multiple IPS datasets, the results indicate that the optimized model achieves a $12.50 \%$ to $16.82 \%$ improvement in prediction accuracy, demonstrating enhanced robustness and accuracy across various prediction lengths.

Nanjing University of Science and Technology (CN), Nanjing University of Posts and Telecommunications (CN), Southeast University (CN)
Openalex Percentile: Top 70%
Time Series Analysis and Forecasting
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

A Feature Enhancement Framework Based on Pre-trained Foundation Models for Time-series Forecasting in EIoT — Pengcheng Xia, Yiyang Ni, et al. · (2025) | TGRS Research Map | TGRS