CKADformer: Enhanced Transformer with Causal Convolution and KAN for Multivariate Time Series Anomaly Detection
With the rapid advancement of IoT technologies, multivariate time series (MTS) anomaly detection has gained increasing prominence across industrial and financial domains. While Transformer-based models have demonstrated remarkable progress in capturing MTS correlations, they still face critical challenges: conventional self-attention mechanisms struggle to discern feature importance and inadequately amplify distinctions between adjacent anomalous and normal data points. To address this, we propose CKADformer, a novel model incorporating the CKAD-Attention mechanism, which integrates causal convolutions with Kolmogorov-Arnold Networks (KANs) to enhance discriminative feature representation in time series. The proposed mechanism comprises two branches: 1) a Gaussian prior association branch that models adjacent normal temporal patterns using learnable Gaussian kernels, and 2) an enhanced series association branch that extracts KANLinear networks to strengthen global feature interactions. Furthermore, by employing a minimax strategy to dynamically optimize the divergence distribution between prior and series associations, our model significantly amplifies the separability between anomalous and normal data. Experimental results demonstrate that CKADformer outperforms 4 advanced baselines across three real-world datasets. This study establishes a new paradigm for feature enhancement and divergence optimization in MTS anomaly detection, offering broad applicability.
Authors
- Ruliang Xiao (ORCID: https://orcid.org/0000-0003-2173-4612)
- Xiaorui Huang (ORCID: https://orcid.org/0000-0003-0371-5899)
- Xiangling Chen
Institutions
- Fujian Normal University (CN)
Publication Details
- Published
- 2025-06-20
- DOI
- https://doi.org/10.1109/icecai66283.2025.11171201
- Primary Topic
- Anomaly Detection Techniques and Applications
- Type
- article
- Field-Weighted Citation Impact
- 0.00