Prompt Generation for Enhanced Camouflaged Object Detection in Low-Altitude Economy
To ensure the safety of both aircraft and operators in low-altitude economy (LAE) activities, precise environmental perception capabilities are essential for effective collision prevention. However, achieving accurate perception remains challenging, particularly when obstacles are camouflaged and visually blended into their surroundings, making detection difficult, even with the robust foundation model, the Segment Anything Model (SAM). Although SAM's prompt-based strategy improves its performance in the Camouflaged Object Detection (COD) task, its reliance on limited prompts introduces new challenges. Instead of manually annotating prompts, our work introduces a multimodal learning approach that utilizes a Vision-Language Model (VLM) to automatically generate mask prompts. By integrating visual and textual information, this work generates high-quality prompts that significantly enhance the performance of SAM in identifying camouflaged objects. Experimental results demonstrate that the proposed method achieves an average improvement of 13% over the baseline SAM across three COD benchmark datasets.
Authors
- Hengyan Liu (ORCID: https://orcid.org/0009-0001-7834-7691)
- Wenzhang Zhang (ORCID: https://orcid.org/0000-0001-9549-5832)
- Bintao Hu (ORCID: https://orcid.org/0000-0003-4821-0448)
- Guangyu Ren
- Xiaoguang Chen (ORCID: https://orcid.org/0000-0002-0750-6544)
- Xuehan Chen (ORCID: https://orcid.org/0000-0002-8202-1774)
- Xi Fan Yao (ORCID: https://orcid.org/0009-0008-6243-5938)
Institutions
- China Mobile (China) (CN)
- Shanghai Industrial Boiler Research Institute (China) (CN)
- Shanghai Industrial Technology Institute (CN)
- Xi’an Jiaotong-Liverpool University (CN)
Publication Details
- Published
- 2025-06-17
- DOI
- https://doi.org/10.1109/vtc2025-spring65109.2025.11174770
- Primary Topic
- Visual Attention and Saliency Detection
- Type
- article
- Field-Weighted Citation Impact
- 0.00