ICASSP 2026 CONVERGE Challenge: Multimodal Fingerprinting for UE Localization

This paper addresses the limitation of vision-based UE localization, which performs well when the UE is within the camera field of view (FoV) but degrades when the UE moves outside the FoV. To overcome this, we propose a multimodal UE localization approach that jointly exploits 5G radio measurements and visual information from red-green-blue (RGB) frames. Radio, image, and ground-truth data are temporally aligned using time sample information. Compact visual embeddings are extracted using a pre-trained ResNet50 backbone. These embeddings are fused with selected radio features to form a unified fingerprint, which is mapped to the 3D UE position using a multilayer perceptron. Experiments on the ICASSP 2026 CONVERGE Task 2 dataset show that the proposed multimodal approach achieves low localization error and consistently outperforms single-modality baselines.

Authors

Institutions

Publication Details

Published
2026-04-21
DOI
https://doi.org/10.1109/icassp55912.2026.11463495
Primary Topic
Advanced Image and Video Retrieval Techniques
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

ICASSP 2026 CONVERGE Challenge: Multimodal Fingerprinting for UE Localization

Hanan Al-Tous, Norshahida Saba
Advanced Image and Video Retrieval Techniques
article

ICASSP 2026 CONVERGE Challenge: Multimodal Fingerprinting for UE Localization

Hanan Al-Tous, Norshahida Saba
article en

Abstract

This paper addresses the limitation of vision-based UE localization, which performs well when the UE is within the camera field of view (FoV) but degrades when the UE moves outside the FoV. To overcome this, we propose a multimodal UE localization approach that jointly exploits 5G radio measurements and visual information from red-green-blue (RGB) frames. Radio, image, and ground-truth data are temporally aligned using time sample information. Compact visual embeddings are extracted using a pre-trained ResNet50 backbone. These embeddings are fused with selected radio features to form a unified fingerprint, which is mapped to the 3D UE position using a multilayer perceptron. Experiments on the ICASSP 2026 CONVERGE Task 2 dataset show that the proposed multimodal approach achieves low localization error and consistently outperforms single-modality baselines.

Aalto University (FI)
Openalex Percentile: Top 20%
Advanced Image and Video Retrieval Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.