Deep Self-Supervised Learning Network for Multiexposure Image Fusion in Fringe Structured-Light 3-D Reconstruction

Fringe structured-light 3-D reconstruction is a key technology for obtaining the surface morphology of objects in high-precision industrial production. However, in high dynamic range (HDR) scenarios, due to complex object surface reflectivity and lighting conditions, the captured images often contain abnormal exposure areas, leading to poor reconstruction results. To address this challenge, we propose a fringe structured-light multiexposure image fusion (MEF) algorithm based on deep self-supervised learning. We design a self-supervised learning network, SMEF, to fuse images captured under different exposure conditions, achieving fusion without relying on ground truth images and eliminating abnormal exposure regions. Additionally, to mitigate the spectral bias phenomenon where neural networks tend to learn low-frequency information during image fusion while preserving the structured-light fringe characteristics, we designed a combined loss function based on structural similarity and Fourier domain losses to enhance the structured-light fringes. Experimental results demonstrate that the fused images not only improve the accuracy and robustness to noise of 3-D reconstruction but also produce a more complete reconstruction, effectively addressing the issue of point cloud gaps in structured-light 3-D reconstruction in HDR scenarios.

Authors

Institutions

Publication Details

Journal
IEEE Transactions on Instrumentation and Measurement
Published
2025-01-01
DOI
https://doi.org/10.1109/tim.2025.3556819
Citations
2
Primary Topic
Advanced Image Fusion Techniques
Type
article
Field-Weighted Citation Impact
2.27

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Deep Self-Supervised Learning Network for Multiexposure Image Fusion in Fringe Structured-Light 3-D Reconstruction

Lanlan Zhang, Fuqiang Zhou, Shuo Wang, Wanning Zhang et al.
2 citations
IEEE Transactions on Instrumentation and Measurement
Advanced Image Fusion Techniques
2.27
article

Deep Self-Supervised Learning Network for Multiexposure Image Fusion in Fringe Structured-Light 3-D Reconstruction

Lanlan Zhang, Fuqiang Zhou, Shuo Wang, Wanning Zhang, Xinghan Wang
article en
2 citations

Abstract

Fringe structured-light 3-D reconstruction is a key technology for obtaining the surface morphology of objects in high-precision industrial production. However, in high dynamic range (HDR) scenarios, due to complex object surface reflectivity and lighting conditions, the captured images often contain abnormal exposure areas, leading to poor reconstruction results. To address this challenge, we propose a fringe structured-light multiexposure image fusion (MEF) algorithm based on deep self-supervised learning. We design a self-supervised learning network, SMEF, to fuse images captured under different exposure conditions, achieving fusion without relying on ground truth images and eliminating abnormal exposure regions. Additionally, to mitigate the spectral bias phenomenon where neural networks tend to learn low-frequency information during image fusion while preserving the structured-light fringe characteristics, we designed a combined loss function based on structural similarity and Fourier domain losses to enhance the structured-light fringes. Experimental results demonstrate that the fused images not only improve the accuracy and robustness to noise of 3-D reconstruction but also produce a more complete reconstruction, effectively addressing the issue of point cloud gaps in structured-light 3-D reconstruction in HDR scenarios.

IEEE Transactions on Instrumentation and MeasurementVol. 74
China Academy Of Machinery Science & Technology (China) (CN), Beihang University (CN)
National Natural Science Foundation of China
Openalex Percentile: Top 12%
Advanced Image Fusion Techniques
2.27
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.