Fiducial marker-based decentralized computer vision for structural modal identification

• Introduces novel vision-based approach for decentralized vibration measurement in structural health monitoring. • Integrates multiple cameras in a decentralized setup for full-field measurement, capturing high-density spatial data in high resolution. • Uses fiducial markers as inexpensive virtual sensors for 3D time series extraction via camera calibration and pose estimation. • Offers contactless and remote measurements with high spatial density, reducing cost and time compared to traditional methods. • Validated through rigorous laboratory tests on building and beam models, and field tests on a truss bridge. Due to the advancement in optics and computer vision, the implementation of the vision-based technique is extensively being investigated for structural health monitoring. Compared with traditional contact sensing measurements, computer-vision technology offers contactless and remote measurements with high spatial density at low cost and instrumentation time. This study proposes an innovative contactless vision-based decentralized vibration measurement technique, where the fiducial marker is utilized as an inexpensive virtual sensor to extract structural vibration measurements using 3D pose estimation through camera calibration. Once the vibration measurements are extracted, covariance-driven stochastic subspace identification is employed due to its robustness for effective mode decomposition and noise reduction capabilities. This paper enables the extraction of 3D time series without deploying a stereo camera system and combines the multiple fields of view of different regions of interest from various cameras in a decentralized manner to capture high-density and high-resolution spatial data for full-field measurement. Two laboratory tests were conducted on a lab-scale building model and a lab-scale beam model to validate the robustness and effectiveness of the proposed methodology. Following the laboratory validation, field tests on a full-scale truss bridge were performed to demonstrate the efficacy of the proposed technique. The relative error in the estimation of the modal frequencies in lab-scale experimentation is <2 %, whereas, for the field study, it is <5.5 %, considering the working distance between the camera and field bridge is over 30 m. The modal assurance criterion (MAC) between the extracted mode shapes is also estimated, and the average MAC values for lab-scale building and lab-scale beam models are 98.61 % and 97.28 %, respectively. The proposed technique has proven to capture the minuscule vibration of the structure at a considerable distance between the structure and the vision-based system, including a detailed comparative study between the vision-based system and accelerometers.

Authors

Institutions

Publication Details

Journal
Journal of Sound and Vibration
Published
2025-04-24
DOI
https://doi.org/10.1016/j.jsv.2025.119152
Citations
11
Primary Topic
Structural Health Monitoring Techniques
Type
article
Field-Weighted Citation Impact
10.49

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Fiducial marker-based decentralized computer vision for structural modal identification

Shivank Mittal, Ayan Sadhu
11 citations
Journal of Sound and Vibration
Structural Health Monitoring Techniques
10.49
article

Fiducial marker-based decentralized computer vision for structural modal identification

Shivank Mittal, Ayan Sadhu
article en
11 citations

Abstract

• Introduces novel vision-based approach for decentralized vibration measurement in structural health monitoring. • Integrates multiple cameras in a decentralized setup for full-field measurement, capturing high-density spatial data in high resolution. • Uses fiducial markers as inexpensive virtual sensors for 3D time series extraction via camera calibration and pose estimation. • Offers contactless and remote measurements with high spatial density, reducing cost and time compared to traditional methods. • Validated through rigorous laboratory tests on building and beam models, and field tests on a truss bridge. Due to the advancement in optics and computer vision, the implementation of the vision-based technique is extensively being investigated for structural health monitoring. Compared with traditional contact sensing measurements, computer-vision technology offers contactless and remote measurements with high spatial density at low cost and instrumentation time. This study proposes an innovative contactless vision-based decentralized vibration measurement technique, where the fiducial marker is utilized as an inexpensive virtual sensor to extract structural vibration measurements using 3D pose estimation through camera calibration. Once the vibration measurements are extracted, covariance-driven stochastic subspace identification is employed due to its robustness for effective mode decomposition and noise reduction capabilities. This paper enables the extraction of 3D time series without deploying a stereo camera system and combines the multiple fields of view of different regions of interest from various cameras in a decentralized manner to capture high-density and high-resolution spatial data for full-field measurement. Two laboratory tests were conducted on a lab-scale building model and a lab-scale beam model to validate the robustness and effectiveness of the proposed methodology. Following the laboratory validation, field tests on a full-scale truss bridge were performed to demonstrate the efficacy of the proposed technique. The relative error in the estimation of the modal frequencies in lab-scale experimentation is <2 %, whereas, for the field study, it is <5.5 %, considering the working distance between the camera and field bridge is over 30 m. The modal assurance criterion (MAC) between the extracted mode shapes is also estimated, and the average MAC values for lab-scale building and lab-scale beam models are 98.61 % and 97.28 %, respectively. The proposed technique has proven to capture the minuscule vibration of the structure at a considerable distance between the structure and the vision-based system, including a detailed comparative study between the vision-based system and accelerometers.

Journal of Sound and VibrationVol. 612
Western University (CA)
Canada Foundation for Innovation, Canada Research Chairs, Natural Sciences and Engineering Research Council of Canada
Openalex Percentile: Top 1%
Structural Health Monitoring Techniques
10.49
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.