A Novel Approach for Image-Text Matching Cross-Modal Space Learning
Image-text matching is a crucial area in image processing and AI, focusing on computing the similarity between a natural language sentence and an image to create a unified space for comparison. Traditional methods often struggle with effectively bridging the gap between visual and verbal communication, leading to suboptimal performance. We propose a novel approach that directly addresses these challenges by utilizing advanced matrix operations that cater specifically to the distinct characteristics of visual and textual data. Our method significantly enhances the speed and accuracy of the matching process, reduces computational complexity, and eliminates the need for additional resources. We introduce an innovative optimization strategy using the Firefly Algorithm, which optimizes the alignment of image and text features within a shared cross-modal space. Experimental results on standard datasets like MS-COCO and Flickr30K demonstrate notable improvements in matching precision and processing speed, validating the effectiveness of our approach in advancing the state-of-the-art in image-text matching. This research contributes broadly to multimodal AI, paving the way for more sophisticated systems capable of seamlessly integrating and interpreting complex visual and textual information
Authors
- A. Ebrahimi (ORCID: https://orcid.org/0009-0009-5103-9419)
- Mohammad Javad Parseh (ORCID: https://orcid.org/0000-0003-0109-3133)
- Pejman Rasti
Institutions
- Jahrom University (IR)
- Laboratoire Angevin de Recherche en Mathématiques (FR)
Publication Details
- Published
- 2024-11-19
- DOI
- https://doi.org/10.1109/iccke65377.2024.10874683
- Primary Topic
- Image Retrieval and Classification Techniques
- Type
- article
- Field-Weighted Citation Impact
- 0.00