Self-Supervised Intelligent Autoencoder with Multi-Scale Convolutional Contrastive Learning for Multivariate Anomaly Detection

Autonomous anomaly detection in multivariate time-series is essential for ensuring safety in industrial and aerospace systems, yet is hindered by high-dimensional signals and limited fault samples. This paper proposes a self-supervised autoencoder that integrates multi-scale convolutions (kernel sizes 3/5/7) with a Transformer encoder augmented by T5-style relative position bias, enabling joint modeling of local transient patterns and long-range temporal dependencies. To enhance representation learning under scarce anomaly labels, we leverage SimCLR-based contrastive pretraining to refine normal-data feature distributions. To address fragmented detections, we design an event-level aggregation strategy that merges window-level reconstruction errors via Top-k peak averaging and rule-based filtering. Evaluated on the SMAP benchmark and our in-house industrial dataset, named CAFUC2, our method achieves event-level F1 of 0.97 and 0.83, respectively outperforming traditional baseline methods and demonstrating robust generalization to real-world flight anomalies.

Authors

Institutions

Publication Details

Journal
Journal of Intelligent & Fuzzy Systems
Published
2025-12-22
DOI
https://doi.org/10.1177/18758967251407728
Primary Topic
Anomaly Detection Techniques and Applications
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Self-Supervised Intelligent Autoencoder with Multi-Scale Convolutional Contrastive Learning for Multivariate Anomaly Detection

Yali Fang, Jing Lu, Xuan Wu, Songhan Fan
Journal of Intelligent & Fuzzy Systems
Anomaly Detection Techniques and Applications
article

Self-Supervised Intelligent Autoencoder with Multi-Scale Convolutional Contrastive Learning for Multivariate Anomaly Detection

Yali Fang, Jing Lu, Xuan Wu, Songhan Fan
article en

Abstract

Autonomous anomaly detection in multivariate time-series is essential for ensuring safety in industrial and aerospace systems, yet is hindered by high-dimensional signals and limited fault samples. This paper proposes a self-supervised autoencoder that integrates multi-scale convolutions (kernel sizes 3/5/7) with a Transformer encoder augmented by T5-style relative position bias, enabling joint modeling of local transient patterns and long-range temporal dependencies. To enhance representation learning under scarce anomaly labels, we leverage SimCLR-based contrastive pretraining to refine normal-data feature distributions. To address fragmented detections, we design an event-level aggregation strategy that merges window-level reconstruction errors via Top-k peak averaging and rule-based filtering. Evaluated on the SMAP benchmark and our in-house industrial dataset, named CAFUC2, our method achieves event-level F1 of 0.97 and 0.83, respectively outperforming traditional baseline methods and demonstrating robust generalization to real-world flight anomalies.

Journal of Intelligent & Fuzzy Systems
Civil Aviation Flight University of China (CN), Nanjing University of Aeronautics and Astronautics (CN)
Industry, innovation and infrastructure
Openalex Percentile: Top 19%
Anomaly Detection Techniques and Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.