Res-FormerNet: A Residual–Transformer Fusion Network for 2-D Magnetotelluric Inversion

We propose Res-FormerNet, an improved inversion network that integrates a lightweight Transformer encoder into a ResNet50 backbone to enhance two-dimensional magnetotelluric (MT) inversion. The model is designed to jointly leverage residual convolutional structures for local feature extraction and global attention mechanisms for capturing long-range spatial dependencies in geoelectrical resistivity models. To evaluate the effectiveness of the proposed architecture, more than 100,000 synthetic models generated by a two-dimensional staggered-grid finite-difference forward solver are used to construct training and validation datasets for TE and TM apparent resistivity responses, with realistic noise levels applied to simulate field acquisition conditions. A smoothness-aware loss function is further introduced to improve inversion stability and structural continuity. Results from synthetic tests demonstrate that incorporating the Transformer encoder substantially enhances the recovery of large-scale anomalies, structural boundaries, and resistivity contrasts compared with the original ResNet50. The proposed method also exhibits strong generalization capability when applied to real MT field data from southern Africa, producing inversion results highly consistent with those obtained using the nonlinear conjugate gradient (NLCG) method. These findings confirm that the Res-FormerNet architecture provides an effective and robust framework for MT inversion and illustrate the potential of hybrid convolution–attention networks for advancing data-driven electromagnetic inversion.

Authors

Institutions

Publication Details

Journal
Applied Sciences
Published
2025-12-26
DOI
https://doi.org/10.3390/app16010270
Primary Topic
Geophysical and Geoelectrical Methods
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Res-FormerNet: A Residual–Transformer Fusion Network for 2-D Magnetotelluric Inversion

Zhitao Xiong, Xingong Tang, Junhu Yu
Applied Sciences
Geophysical and Geoelectrical Methods
article

Res-FormerNet: A Residual–Transformer Fusion Network for 2-D Magnetotelluric Inversion

Zhitao Xiong, Xingong Tang, Junhu Yu
article en

Abstract

We propose Res-FormerNet, an improved inversion network that integrates a lightweight Transformer encoder into a ResNet50 backbone to enhance two-dimensional magnetotelluric (MT) inversion. The model is designed to jointly leverage residual convolutional structures for local feature extraction and global attention mechanisms for capturing long-range spatial dependencies in geoelectrical resistivity models. To evaluate the effectiveness of the proposed architecture, more than 100,000 synthetic models generated by a two-dimensional staggered-grid finite-difference forward solver are used to construct training and validation datasets for TE and TM apparent resistivity responses, with realistic noise levels applied to simulate field acquisition conditions. A smoothness-aware loss function is further introduced to improve inversion stability and structural continuity. Results from synthetic tests demonstrate that incorporating the Transformer encoder substantially enhances the recovery of large-scale anomalies, structural boundaries, and resistivity contrasts compared with the original ResNet50. The proposed method also exhibits strong generalization capability when applied to real MT field data from southern Africa, producing inversion results highly consistent with those obtained using the nonlinear conjugate gradient (NLCG) method. These findings confirm that the Res-FormerNet architecture provides an effective and robust framework for MT inversion and illustrate the potential of hybrid convolution–attention networks for advancing data-driven electromagnetic inversion.

Applied SciencesVol. 16(1)
Yangtze University (CN), Ministry of Education (SA)
Openalex Percentile: Top 29%
Geophysical and Geoelectrical Methods
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.