LLM-agent-based cross-modal retrieval method for detecting clues of ecological environment damage
Abstract Within Ecological Conservation Redline zones, ecological environmental damage caused by non-compliant production and construction activities has become increasingly severe. Existing methods typically leverage remote sensing imagery and deep learning techniques to automatically identify unauthorized construction, or retrieve clues of ecological environmental damage from textual information such as public complaints and official circulars. The former often relies on professional experiential knowledge, while the latter remains at the level of passive retrieval; both rely on predefined rules and professional experience and suffer from a time lag. Recently emerging Large Language Model (LLM)-based agents, which possess both natural language understanding and multi-step task execution capabilities, make it possible to acquire and fulfill users’ retrieval demands in a fast and flexible manner through human–machine dialogue. Inspired by this, this paper constructs a multimodal clue retrieval agent for ecological environmental damage based on a multi-agent framework. The agent interacts with users who lack computer professional and technical backgrounds through natural language via LLMs to clarify their retrieval demands regarding specified regions, time periods, and damage types. It then orchestrates different sub-agents to automatically retrieve textual clues and remote sensing image clues within the corresponding spatiotemporal scope in a cross-modal manner, and aggregates and presents textual and image evidence to users to support the review and analysis of problem clues. Testing and evaluation conducted by researchers in the field of procuratorial case handling show that the proposed method achieves satisfactory retrieval performance and usability, and is simple and easy to learn. It can provide technical support for the screening and assessment of ecological environmental damage issues.
Authors
- Lu Bai (ORCID: https://orcid.org/0000-0003-1242-5412)
- Liangfu Chen (ORCID: https://orcid.org/0000-0002-2175-7016)
- Man Zhao (ORCID: https://orcid.org/0009-0008-7630-3020)
- Zhibao Wang
- Xiaoqing He (ORCID: https://orcid.org/0009-0005-7357-1802)
- Fucai Ben
- Shiyao Lu
Institutions
- Qiqihar University (CN)
- Queen's University Belfast (GB)
- Chinese Academy of Sciences (CN)
- Aerospace Information Research Institute (CN)
- University of Chinese Academy of Sciences (CN)
- State Key Laboratory of Remote Sensing Science (CN)
- Northeast Petroleum University (CN)
Publication Details
- Journal
- Scientific Reports
- Published
- 2026-11-15
- DOI
- https://doi.org/10.1038/s41598-026-80668-x
- Primary Topic
- Artificial Intelligence in Law
- Type
- article
- Field-Weighted Citation Impact
- 0.00