Predicting Time Series with Adjusting Feature Weight: An Integrated Method Based on Large Language Models and SHAP

Social computing, an emerging interdisciplinary field, is centered on understanding and predicting human social behaviors and their patterns. Despite the important role of time series prediction in social computing, existing model-driven approaches often ignore the significant impact that data feature weights can have on time series prediction tasks. This limitation leads to many predictive models performing well on standard test data but failing to achieve the expected accuracy on real-world social computing data. Recent studies have shown that Large Language Models (LLMs) possess strong pattern recognition and reasoning capabilities for sequences. However, effectively applying their amazing text reasoning abilities to social computing and time series forecasting remains challenging. To solve these two significant research gaps, this study proposes an innovative time series forecasting model based on LLMs and SHAP. This model is an adaptive multimodal supervised learning framework that can both combine time series data with token embedding data and dynamically adjust feature weights after a few training iterations to recognize the feature patterns hidden behind real-world data. By the proposed model structure, this model can focus on features with the greatest influence on the prediction results, hence improving prediction performance with stability and promoting LLMs' application in time series prediction related to social computing. Besides conventional performance testing, this study also proposes an evaluation indicator for measuring the feature weight adjustment effect of time series models. This effectively enriches model evaluation dimensions and allows for diversified evaluation of time series models.

Authors

Institutions

Publication Details

Published
2024-10-18
DOI
https://doi.org/10.1109/mlnlp63328.2024.10800570
Primary Topic
Time Series Analysis and Forecasting
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Predicting Time Series with Adjusting Feature Weight: An Integrated Method Based on Large Language Models and SHAP

Corey Kewei Xu, Fang Keyuan
Time Series Analysis and Forecasting
article

Predicting Time Series with Adjusting Feature Weight: An Integrated Method Based on Large Language Models and SHAP

Corey Kewei Xu, Fang Keyuan
article en

Abstract

Social computing, an emerging interdisciplinary field, is centered on understanding and predicting human social behaviors and their patterns. Despite the important role of time series prediction in social computing, existing model-driven approaches often ignore the significant impact that data feature weights can have on time series prediction tasks. This limitation leads to many predictive models performing well on standard test data but failing to achieve the expected accuracy on real-world social computing data. Recent studies have shown that Large Language Models (LLMs) possess strong pattern recognition and reasoning capabilities for sequences. However, effectively applying their amazing text reasoning abilities to social computing and time series forecasting remains challenging. To solve these two significant research gaps, this study proposes an innovative time series forecasting model based on LLMs and SHAP. This model is an adaptive multimodal supervised learning framework that can both combine time series data with token embedding data and dynamically adjust feature weights after a few training iterations to recognize the feature patterns hidden behind real-world data. By the proposed model structure, this model can focus on features with the greatest influence on the prediction results, hence improving prediction performance with stability and promoting LLMs' application in time series prediction related to social computing. Besides conventional performance testing, this study also proposes an evaluation indicator for measuring the feature weight adjustment effect of time series models. This effectively enriches model evaluation dimensions and allows for diversified evaluation of time series models.

Hong Kong University of Science and Technology (HK), University of Hong Kong (HK)
Openalex Percentile: Top 74%
Time Series Analysis and Forecasting
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Predicting Time Series with Adjusting Feature Weight: An Integrated Method Based on Large Language Models and SHAP — Corey Kewei Xu, Fang Keyuan · (2024) | TGRS Research Map | TGRS