Tree-Guided Transformer for Sensor-Based Ecological Image Feature Extraction and Multitarget Recognition in Agricultural Systems
Farmland ecosystems present complex pest-predator co-occurrence patterns, posing significant challenges for image-based multitarget recognition and ecological modeling in sensor-driven computer vision tasks. To address these issues, this study introduces a tree-guided Transformer framework enhanced with a knowledge-augmented co-attention mechanism, enabling effective feature extraction from sensor-acquired images. A hierarchical ecological taxonomy (Phylum-Family Species) guides prompt-driven semantic reasoning, while an ecological knowledge graph enriches visual representations by embedding co-occurrence priors. A multimodal dataset containing 60 pest and predator categories with annotated images and semantic descriptions was constructed for evaluation. Experimental results demonstrate that the proposed method achieves 90.4% precision, 86.7% recall, and 88.5% F1-score in image classification, along with 82.3% hierarchical accuracy. In detection tasks, it attains 91.6% precision and 86.3% mAP@50, with 80.5% co-occurrence accuracy. For hierarchical reasoning and knowledge-enhanced tasks, F1-scores reach 88.5% and 89.7%, respectively. These results highlight the framework's strong capability in extracting structured, semantically aligned image features under real-world sensor conditions, offering an interpretable and generalizable approach for intelligent agricultural monitoring.
Authors
- Zi‐Gang Huang (ORCID: https://orcid.org/0000-0001-9648-3067)
- M. Q. Ruan (ORCID: https://orcid.org/0000-0001-7553-9236)
- Yiqiang Sun (ORCID: https://orcid.org/0000-0002-7121-1214)
- Shuo Yan (ORCID: https://orcid.org/0000-0001-9685-9810)
- Linfeng Yang (ORCID: https://orcid.org/0000-0001-9587-068X)
- Zihuan Wang (ORCID: https://orcid.org/0000-0002-1270-3251)
- Jingchao Suo
Institutions
- Peking University (CN)
- China Agricultural University (CN)
- Tsinghua University (CN)
Publication Details
- Journal
- Sensors
- Published
- 2025-10-07
- DOI
- https://doi.org/10.3390/s25196206
- Primary Topic
- Smart Agriculture and AI
- Type
- article
- Field-Weighted Citation Impact
- 0.00