DICNO: A Generalizable Digital Image Correlation Neural Operator

Digital Image Correlation (DIC) is an optical metrology for dense displacement and strain fields measurement by tracking speckle patterns sprayed on the objects. As its name indicates, however, DIC relies on local image feature correlations and therefore faces challenges such as high time complexity and difficulties in computing large deformation fields. Although recent deep learning-based DIC methods have significantly accelerated the inference speed, enabling real-time measurements, these models often lack generalization to unseen deformation patterns and to varying resolutions due to their training on single deformation patterns. Additionally, most deep learning approaches train two separate networks for the displacement and strain predictions respectively, failing to leverage the inherent relationship between them. In this paper, we introduce a novel neural operator method for DIC, DICNO, that learns an operator directly mapping the latent features of two consecutive images to the underlying displacement and strain fields. By incorporating a multi-resolution training strategy and continuous feature mapping, DICNO can efficiently handle various image resolutions and gains the scale generalization capability. Extensive experiments show that DICNO outperforms existing models across multiple datasets and complex scenarios, with substantial advantages in both precision and inference speed. The code is available at https://github.com/ZXS-Labs/DICNO.