Transferring Self‐Supervised Pretrained Models for SHM Data Anomaly Detection With Scarce Labeled Data

Structural health monitoring (SHM) has experienced significant advancements in recent decades, accumulating massive monitoring data. Data anomalies inevitably exist in monitoring data, posing significant challenges to their effective utilization. Recently, deep learning has emerged as an efficient and effective approach for anomaly detection in bridge SHM. Despite its progress, many deep learning models require large amounts of labeled data for training. The process of labeling data, however, is labor‐intensive, time‐consuming, and often impractical for large‐scale SHM datasets. To address these challenges, this work explores the use of self‐supervised learning (SSL), an emerging paradigm that employs unsupervised pretraining. The SSL‐based framework aims to learn from only a very small quantity of labeled data by fine‐tuning, while making the best use of the vast amount of unlabeled SHM data by pretraining. Basic and representative models from generative, contrastive, and generative–contrastive SSL categories are employed. These SSL models are compared and validated on the acceleration data of two in‐service bridges, which is one of the most widely utilized types of measurements in SHM. Comparative analysis demonstrates that SSL techniques boost data anomaly detection performance, achieving increased F 1 scores compared to conventional supervised training, especially given a very limited amount of labeled data.

Authors

Institutions

Publication Details

Journal
Structural Control and Health Monitoring
Published
2025-01-01
DOI
https://doi.org/10.1155/stc/2414195
Citations
5
Primary Topic
Anomaly Detection Techniques and Applications
Type
article
Field-Weighted Citation Impact
12.40

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Transferring Self‐Supervised Pretrained Models for SHM Data Anomaly Detection With Scarce Labeled Data

Zhilu Lai, Xudong Jian, Ye Xia, M. Zhou
5 citations
Structural Control and Health Monitoring
Anomaly Detection Techniques and Applications
12.40
article

Transferring Self‐Supervised Pretrained Models for SHM Data Anomaly Detection With Scarce Labeled Data

Zhilu Lai, Xudong Jian, Ye Xia, M. Zhou
article en
5 citations

Abstract

Structural health monitoring (SHM) has experienced significant advancements in recent decades, accumulating massive monitoring data. Data anomalies inevitably exist in monitoring data, posing significant challenges to their effective utilization. Recently, deep learning has emerged as an efficient and effective approach for anomaly detection in bridge SHM. Despite its progress, many deep learning models require large amounts of labeled data for training. The process of labeling data, however, is labor‐intensive, time‐consuming, and often impractical for large‐scale SHM datasets. To address these challenges, this work explores the use of self‐supervised learning (SSL), an emerging paradigm that employs unsupervised pretraining. The SSL‐based framework aims to learn from only a very small quantity of labeled data by fine‐tuning, while making the best use of the vast amount of unlabeled SHM data by pretraining. Basic and representative models from generative, contrastive, and generative–contrastive SSL categories are employed. These SSL models are compared and validated on the acceleration data of two in‐service bridges, which is one of the most widely utilized types of measurements in SHM. Comparative analysis demonstrates that SSL techniques boost data anomaly detection performance, achieving increased F 1 scores compared to conventional supervised training, especially given a very limited amount of labeled data.

Structural Control and Health MonitoringVol. 2025(1)
Tongji University (CN), Entrust (GB), Hong Kong University of Science and Technology (HK), ETH Zurich (CH), Shanghai FRP Research Institute (China) (CN), Deutsche Telekom (Singapore) (SG), University of Hong Kong (HK)
National Research Foundation, National Natural Science Foundation of China, Hong Kong University of Science and Technology
Openalex Percentile: Top 2%
Anomaly Detection Techniques and Applications
12.40
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.