Mixed Global and Local Attention Alleviates Domain Shift Between Terahertz Image Datasets

Terahertz imaging technology has a broad application prospect in the field of security inspection due to its strong penetrability and negligible radiation effect on people. With the development of machine learning in recent years, the application of machine learning methods to security inspection can save labor costs and ensure the accuracy of long-time security inspection. However, terahertz imagers produce different bottom noise at different temperatures, which leads to a significant domain offset problem between data sets collected at different temperatures. This domain shift makes the model trained on the source domain dataset to have a significant error when applied to the target domain dataset. Therefore, how to overcome the temperature-induced domain offset is an urgent problem for terahertz imaging techniques. In this paper, we innovatively propose to apply the attention mechanism to solve the problem of domain bias in object detection. We propose a lightweight attention mechanism Mixed global and local attention(MGLA) aimed at mitigating the domain shift between the target and source domains without affecting the source domain detection effect. MGLA can take into account the local information while fusing the channel information and spatial information and global information to improve the representation of the network. The experiment results show a 10% improvement in mAP0.5 and a 6.3% improvement in mAP50:95 compared to YOLOV8 baseline.

Authors

Institutions

Publication Details

Published
2024-08-19
DOI
https://doi.org/10.1109/icspcc62635.2024.10770373
Primary Topic
Terahertz technology and applications
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Mixed Global and Local Attention Alleviates Domain Shift Between Terahertz Image Datasets

Shaoxing Cui, Xiaoyi Feng, Rao Fu
Terahertz technology and applications
article

Mixed Global and Local Attention Alleviates Domain Shift Between Terahertz Image Datasets

Shaoxing Cui, Xiaoyi Feng, Rao Fu
article en

Abstract

Terahertz imaging technology has a broad application prospect in the field of security inspection due to its strong penetrability and negligible radiation effect on people. With the development of machine learning in recent years, the application of machine learning methods to security inspection can save labor costs and ensure the accuracy of long-time security inspection. However, terahertz imagers produce different bottom noise at different temperatures, which leads to a significant domain offset problem between data sets collected at different temperatures. This domain shift makes the model trained on the source domain dataset to have a significant error when applied to the target domain dataset. Therefore, how to overcome the temperature-induced domain offset is an urgent problem for terahertz imaging techniques. In this paper, we innovatively propose to apply the attention mechanism to solve the problem of domain bias in object detection. We propose a lightweight attention mechanism Mixed global and local attention(MGLA) aimed at mitigating the domain shift between the target and source domains without affecting the source domain detection effect. MGLA can take into account the local information while fusing the channel information and spatial information and global information to improve the representation of the network. The experiment results show a 10% improvement in mAP0.5 and a 6.3% improvement in mAP50:95 compared to YOLOV8 baseline.

Northwestern Polytechnical University (CN), Xi'an University of Technology (CN)
Climate action
Openalex Percentile: Top 77%
Terahertz technology and applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.