Research on a multimodal computer vision target detection algorithm based on a deep neural network

Remote sensing target detection benefits from multimodal data RGB, infrared (IR), and synthetic aperture radar (SAR) yet most unimodal systems struggle with noise, occlusion, and low-visibility conditions, creating a performance gap in complex scenes. To address these limitations, the research introduces a Scalable Penguin with Attention-Intelligent Deep Neural Network (SP-Att-IDeepNet), designed to handle cross-modal inconsistencies and strengthen feature learning. Contrast enhancement using histogram equalization is applied to IR and SAR inputs, and a modified ResNet-50 backbone extracts unified semantic representations. The framework combines the global search ability of the SP optimizer with attention-driven deep feature refinement, improving convergence stability and detection reliability. Experimental evaluation on synchronized RGB–IR–SAR datasets demonstrate strong performance, achieving 97.03% [email protected], 93.07% precision, 94.52% recall, and 96% F1-score, surpassing existing approaches. The model’s scalability and robustness position it well for real-time use in surveillance, disaster assessment, and environmental monitoring.

Authors

Institutions

Publication Details

Journal
Discover Artificial Intelligence
Published
2026-01-29
DOI
https://doi.org/10.1007/s44163-025-00804-w
Primary Topic
Advanced Neural Network Applications
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Research on a multimodal computer vision target detection algorithm based on a deep neural network

S Z Zhang
Discover Artificial Intelligence
Advanced Neural Network Applications
article

Research on a multimodal computer vision target detection algorithm based on a deep neural network

S Z Zhang
article en

Abstract

Remote sensing target detection benefits from multimodal data RGB, infrared (IR), and synthetic aperture radar (SAR) yet most unimodal systems struggle with noise, occlusion, and low-visibility conditions, creating a performance gap in complex scenes. To address these limitations, the research introduces a Scalable Penguin with Attention-Intelligent Deep Neural Network (SP-Att-IDeepNet), designed to handle cross-modal inconsistencies and strengthen feature learning. Contrast enhancement using histogram equalization is applied to IR and SAR inputs, and a modified ResNet-50 backbone extracts unified semantic representations. The framework combines the global search ability of the SP optimizer with attention-driven deep feature refinement, improving convergence stability and detection reliability. Experimental evaluation on synchronized RGB–IR–SAR datasets demonstrate strong performance, achieving 97.03% [email protected], 93.07% precision, 94.52% recall, and 96% F1-score, surpassing existing approaches. The model’s scalability and robustness position it well for real-time use in surveillance, disaster assessment, and environmental monitoring.

Discover Artificial IntelligenceVol. 6(1)
South China University of Technology (CN)
Climate action
Openalex Percentile: Top 76%
Advanced Neural Network Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Research on a multimodal computer vision target detection algorithm based on a deep neural network — S Z Zhang · Discover Artificial Intelligence (2026) | TGRS Research Map | TGRS