An evaluation of DUSt3R/MASt3R/VGGT 3D reconstruction on photogrammetric aerial blocks

State-of-the-art 3D computer vision algorithms continue to improve on sparse, unordered image sets. Recently developed foundational models for 3D reconstruction, such as dense and unconstrained stereo 3d reconstruction (DUSt3R), matching and stereo 3d reconstruction (MASt3R), and visual geometry grounded transformer (VGGT), have attracted considerable attention due to their ability to handle very sparse image overlaps, as well as their generalization capability. In light of this contribution, evaluating DUSt3R/MASt3R/VGGT on typical aerial images is important, as these models may hold the potential to handle extremely low image overlaps, stereo occlusions, and textureless regions. For highly redundant collections, they can accelerate 3D reconstruction by using extremely sparsified image sets. Despite being tested on various computer vision benchmarks, their potential on photogrammetric aerial blocks remains unexplored. We present a comprehensive evaluation of the pre-trained DUSt3R/MASt3R/VGGT models on the aerial blocks of the UseGeo dataset for pose estimation and dense 3D reconstruction. The methods reconstruct dense point clouds from very sparse inputs (fewer than ten images, resized to a maximum dimension of 518 pixels), achieving reasonable accuracy and completeness gains up to 50% over COLMAP. VGGT further shows superior computational efficiency, scalability, and more reliable camera pose estimation. However, all three show limitations on high-resolution imagery and large image sets, with the camera pose estimation reliability significantly declining as the number of images and the geometric complexity of the scene increase. These findings indicate that while transformer-based methods cannot replace traditional SfM and MVS methods entirely, they hold potential as complementary approaches, especially in challenging, low-resolution, and extremely sparse scenarios.

Authors

Institutions

Publication Details

Journal
Geo-spatial Information Science
Published
2025-12-11
DOI
https://doi.org/10.1080/10095020.2025.2597491
Primary Topic
Robotics and Sensor-Based Localization
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

An evaluation of DUSt3R/MASt3R/VGGT 3D reconstruction on photogrammetric aerial blocks

Rongjun Qin, Markus Ulrich, Steven Landgraf, Xinyi Wu
Geo-spatial Information Science
Robotics and Sensor-Based Localization
article

An evaluation of DUSt3R/MASt3R/VGGT 3D reconstruction on photogrammetric aerial blocks

Rongjun Qin, Markus Ulrich, Steven Landgraf, Xinyi Wu
article en

Abstract

State-of-the-art 3D computer vision algorithms continue to improve on sparse, unordered image sets. Recently developed foundational models for 3D reconstruction, such as dense and unconstrained stereo 3d reconstruction (DUSt3R), matching and stereo 3d reconstruction (MASt3R), and visual geometry grounded transformer (VGGT), have attracted considerable attention due to their ability to handle very sparse image overlaps, as well as their generalization capability. In light of this contribution, evaluating DUSt3R/MASt3R/VGGT on typical aerial images is important, as these models may hold the potential to handle extremely low image overlaps, stereo occlusions, and textureless regions. For highly redundant collections, they can accelerate 3D reconstruction by using extremely sparsified image sets. Despite being tested on various computer vision benchmarks, their potential on photogrammetric aerial blocks remains unexplored. We present a comprehensive evaluation of the pre-trained DUSt3R/MASt3R/VGGT models on the aerial blocks of the UseGeo dataset for pose estimation and dense 3D reconstruction. The methods reconstruct dense point clouds from very sparse inputs (fewer than ten images, resized to a maximum dimension of 518 pixels), achieving reasonable accuracy and completeness gains up to 50% over COLMAP. VGGT further shows superior computational efficiency, scalability, and more reliable camera pose estimation. However, all three show limitations on high-resolution imagery and large image sets, with the camera pose estimation reliability significantly declining as the number of images and the geometric complexity of the scene increase. These findings indicate that while transformer-based methods cannot replace traditional SfM and MVS methods entirely, they hold potential as complementary approaches, especially in challenging, low-resolution, and extremely sparse scenarios.

Geo-spatial Information Science
Karlsruhe Institute of Technology (DE), The Ohio State University (US)
Openalex Percentile: Top 49%
Robotics and Sensor-Based Localization
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.