Descriptor Impact on Multimodal 3D Retrieval

With the evolution of 3D tools, there is now plenty of 3D data for digital applications. This includes 3D retrieval, which seeks to access such data across varied representations such as point clouds, meshes, and multi-view images. However, comprehensive analysis of how to efficiently utilize these representations, or modalities, for retrieval has been missing. This paper evaluates different encodings of each modality in uni-modal retrieval and explores optimal combinations for multimodal retrieval, with state-of-the-art methods from the 3D and image retrieval domains. Results indicate, e.g., that the MuseHash method performs best on mean average precision (MAP), while the CMCL method excels in recall.

Authors

Institutions

Publication Details

Published
2024-09-18
DOI
https://doi.org/10.1109/cbmi62980.2024.10859199
Primary Topic
Advanced Image and Video Retrieval Techniques
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Descriptor Impact on Multimodal 3D Retrieval

Ilias Gialampoukidis, Sotiris Diplaris, Stefanos Vrochidis, Maria-Eirini Pegia et al.
Advanced Image and Video Retrieval Techniques
article

Descriptor Impact on Multimodal 3D Retrieval

Ilias Gialampoukidis, Sotiris Diplaris, Stefanos Vrochidis, Maria-Eirini Pegia, Anastasia Moumtzidou, Ioannis Yiannis Kompatsiaris, Björn Pór Jónsson
article en

Abstract

With the evolution of 3D tools, there is now plenty of 3D data for digital applications. This includes 3D retrieval, which seeks to access such data across varied representations such as point clouds, meshes, and multi-view images. However, comprehensive analysis of how to efficiently utilize these representations, or modalities, for retrieval has been missing. This paper evaluates different encodings of each modality in uni-modal retrieval and explores optimal combinations for multimodal retrieval, with state-of-the-art methods from the 3D and image retrieval domains. Results indicate, e.g., that the MuseHash method performs best on mean average precision (MAP), while the CMCL method excels in recall.

Reykjavík University (IS), Information Technologies Institute (GR), Centre for Research and Technology Hellas (GR)
Openalex Percentile: Top 73%
Advanced Image and Video Retrieval Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.