UAV Camera Relocation Method Based on Image Retrieval

无人机视觉重定位技术是其在GPS拒止环境下实现自主导航的核心支撑,广泛应用于城市巡检、灾害救援等场景。然而,复杂动态环境导致传统方法面临特征匹配歧义性高、位姿解算累积误差大等挑战。针对此,本文提出一种基于图像检索的无人机相机重定位方法,采用改进的MobileNetV2骨干网络,结合深度可分离卷积与反向残差模块的通道扩展–压缩策略,在减少参数量的同时保留关键几何信息;全局分支引入可微分NetVLAD层动态聚合局部特征,生成紧凑的4096维描述符;局部特征提取分支设计双解码器架构,利用子像素卷积与双三次插值实现高精度关键点检测与连续性描述子生成,并结合图注意力网络动态筛选几何一致性强的匹配对,通过Sinkhorn算法迭代优化软匹配矩阵,以自适应阈值剔除低置信度噪声。实验表明,该算法在弱纹理、动态遮挡等复杂条件下显著降低位姿误差。UAV visual repositioning technology is the core support for its autonomous navigation in GPS denial environments, which is widely used in urban inspection, disaster rescue and other scenarios. However, the complex dynamic environment causes the traditional method to face challenges such as high ambiguity in feature matching and large cumulative error in position solving. To address this, this paper proposes a UAV camera relocation method based on image retrieval, which adopts an improved MobileNetV2 backbone network, combining a channel expansion-compression strategy with depth-separable convolution and inverse residual module, to reduce the number of parameters while retaining the key geometrical information; a global branch introduces a differentiable NetVLAD layer to dynamically aggregate local features, and generates compact 4096-dimensional descriptors; a local feature extraction branch introduces a local feature extraction branch to dynamically aggregate local features, and generates compact 4096-dimensional descriptors. The global branch introduces a differentiable NetVLAD layer to dynamically aggregate local features and generate compact 4096-dimensional descriptors; the local feature extraction branch designs a dual-decoder architecture, uses sub-pixel convolution and dual cubic interpolation to achieve high-precision keypoint detection and continuity descriptor generation, and combines with the graph-attention network to dynamically screen matching pairs with strong geometric consistency, and optimises the soft-matching matrix iteratively through the Sinkhorn algorithm to reject low-confidence noise by an adaptive thresholding. Experiments show that the algorithm significantly reduces the positional error under complex conditions such as weak texture and dynamic occlusion.

Authors

Publication Details

Journal
Software Engineering and Applications
Published
2025-01-01
DOI
https://doi.org/10.12677/sea.2025.143062
Primary Topic
Robotics and Sensor-Based Localization
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

UAV Camera Relocation Method Based on Image Retrieval

昭扬 任
Software Engineering and Applications
Robotics and Sensor-Based Localization
article

UAV Camera Relocation Method Based on Image Retrieval

昭扬 任
article en

Abstract

无人机视觉重定位技术是其在GPS拒止环境下实现自主导航的核心支撑,广泛应用于城市巡检、灾害救援等场景。然而,复杂动态环境导致传统方法面临特征匹配歧义性高、位姿解算累积误差大等挑战。针对此,本文提出一种基于图像检索的无人机相机重定位方法,采用改进的MobileNetV2骨干网络,结合深度可分离卷积与反向残差模块的通道扩展–压缩策略,在减少参数量的同时保留关键几何信息;全局分支引入可微分NetVLAD层动态聚合局部特征,生成紧凑的4096维描述符;局部特征提取分支设计双解码器架构,利用子像素卷积与双三次插值实现高精度关键点检测与连续性描述子生成,并结合图注意力网络动态筛选几何一致性强的匹配对,通过Sinkhorn算法迭代优化软匹配矩阵,以自适应阈值剔除低置信度噪声。实验表明,该算法在弱纹理、动态遮挡等复杂条件下显著降低位姿误差。UAV visual repositioning technology is the core support for its autonomous navigation in GPS denial environments, which is widely used in urban inspection, disaster rescue and other scenarios. However, the complex dynamic environment causes the traditional method to face challenges such as high ambiguity in feature matching and large cumulative error in position solving. To address this, this paper proposes a UAV camera relocation method based on image retrieval, which adopts an improved MobileNetV2 backbone network, combining a channel expansion-compression strategy with depth-separable convolution and inverse residual module, to reduce the number of parameters while retaining the key geometrical information; a global branch introduces a differentiable NetVLAD layer to dynamically aggregate local features, and generates compact 4096-dimensional descriptors; a local feature extraction branch introduces a local feature extraction branch to dynamically aggregate local features, and generates compact 4096-dimensional descriptors. The global branch introduces a differentiable NetVLAD layer to dynamically aggregate local features and generate compact 4096-dimensional descriptors; the local feature extraction branch designs a dual-decoder architecture, uses sub-pixel convolution and dual cubic interpolation to achieve high-precision keypoint detection and continuity descriptor generation, and combines with the graph-attention network to dynamically screen matching pairs with strong geometric consistency, and optimises the soft-matching matrix iteratively through the Sinkhorn algorithm to reject low-confidence noise by an adaptive thresholding. Experiments show that the algorithm significantly reduces the positional error under complex conditions such as weak texture and dynamic occlusion.

Software Engineering and ApplicationsVol. 14(03)
Openalex Percentile: Top 79%
Robotics and Sensor-Based Localization
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.