Predicting Time Series with Adjusting Feature Weight: An Integrated Method Based on Large Language Models and SHAP
Social computing, an emerging interdisciplinary field, is centered on understanding and predicting human social behaviors and their patterns. Despite the important role of time series prediction in social computing, existing model-driven approaches often ignore the significant impact that data feature weights can have on time series prediction tasks. This limitation leads to many predictive models performing well on standard test data but failing to achieve the expected accuracy on real-world social computing data. Recent studies have shown that Large Language Models (LLMs) possess strong pattern recognition and reasoning capabilities for sequences. However, effectively applying their amazing text reasoning abilities to social computing and time series forecasting remains challenging. To solve these two significant research gaps, this study proposes an innovative time series forecasting model based on LLMs and SHAP. This model is an adaptive multimodal supervised learning framework that can both combine time series data with token embedding data and dynamically adjust feature weights after a few training iterations to recognize the feature patterns hidden behind real-world data. By the proposed model structure, this model can focus on features with the greatest influence on the prediction results, hence improving prediction performance with stability and promoting LLMs' application in time series prediction related to social computing. Besides conventional performance testing, this study also proposes an evaluation indicator for measuring the feature weight adjustment effect of time series models. This effectively enriches model evaluation dimensions and allows for diversified evaluation of time series models.
Authors
- Corey Kewei Xu (ORCID: https://orcid.org/0000-0002-3244-9297)
- Fang Keyuan
Institutions
- Hong Kong University of Science and Technology (HK)
- University of Hong Kong (HK)
Publication Details
- Published
- 2024-10-18
- DOI
- https://doi.org/10.1109/mlnlp63328.2024.10800570
- Primary Topic
- Time Series Analysis and Forecasting
- Type
- article
- Field-Weighted Citation Impact
- 0.00