A Feature Enhancement Framework Based on Pre-trained Foundation Models for Time-series Forecasting in EIoT
With the advancement of the energy internet of things (EIoT), accurate predictive data in industrial power systems (IPS) has become crucial for fault detection, energy management and system optimization. In recent years, TimeSeries Pre-trained Foundation Models (TSPFMs) have demonstrated considerable potential in this application. However, their predictive performance remains constrained when confronted with domain-specific data with high noise, multi-periodic, and complex features. To improve the forecasting ability of TSPFMs, we propose a novel framework that merges a Frequency Enhanced Module (FEM) and a high-dimensional Temporal Position Attention (TPA) mechanism for feature enhancement. To be specific, the FEM processes multi-channel data in the frequency domain, effectively capturing feature independencies. The TPA generates channel-specific attention maps, thereby integrating a broader range of contextual information into local features. Additionally, we introduce a dynamic loss function that adjusts penalties according to the forecasting step size, thereby optimizing the long-term prediction performance. By performing experiments on multiple IPS datasets, the results indicate that the optimized model achieves a $12.50 \%$ to $16.82 \%$ improvement in prediction accuracy, demonstrating enhanced robustness and accuracy across various prediction lengths.
Authors
- Pengcheng Xia (ORCID: https://orcid.org/0000-0001-9034-0639)
- Yiyang Ni (ORCID: https://orcid.org/0000-0001-5893-6854)
- Yiqun Guo (ORCID: https://orcid.org/0009-0003-3507-6646)
- Jun Li (ORCID: https://orcid.org/0000-0003-4566-9536)
Institutions
- Nanjing University of Science and Technology (CN)
- Nanjing University of Posts and Telecommunications (CN)
- Southeast University (CN)
Publication Details
- Published
- 2025-08-10
- DOI
- https://doi.org/10.1109/iccc65529.2025.11148816
- Primary Topic
- Time Series Analysis and Forecasting
- Type
- article
- Field-Weighted Citation Impact
- 0.00