Automating Tree Crown Delineation in UAV Orthomosaics Without Annotation: An Annotation-Free Framework Coupling DeepForest, Segment Anything, and Unsupervised Clustering

Individual-tree-level information on crown distribution and morphology underpins forest inventory, biomass estimation, and carbon accounting. High-resolution Unmanned Aerial Vehicle (UAV) imagery resolves single-tree detail, but automated crown extraction remains difficult: fully supervised segmentation depends on costly pixel-level annotation that generalizes poorly, while the Segment Anything Model (SAM), though training-free, cannot locate trees on its own and existing SAM-based methods restore this ability only by adding task-specific training. We present an end-to-end, annotation-free toolkit for tree crown extraction and ecological analysis. A RetinaNet-based DeepForest detector produces coarse boxes; an adaptive module then removes duplicate boxes and non-vegetation false positives using an intersection-over-union rule and a global greenness index, converting noisy boxes into clean prompts; these prompts drive SAM to decode irregular crown masks without task-specific training; and geometric and texture features are extracted and grouped by principal component analysis and K-means clustering to map ecological patterns. We evaluated the toolkit on multi-biome imagery from the public OAM-TCD dataset. Because pixel-exact metrics are unstable at 10 cm resolution, where wind sway, shadow shift, and small labeling offsets are strongly amplified, we assessed accuracy under an absolute physical-distance tolerance. At a 2.0 m tolerance, consistent with the effective radius of a mature crown, the toolkit reached a precision of 91.25%, a recall of 86.40%, and an F1-score of 88.76%; bootstrap and Monte Carlo resampling confirmed these values are stable. Without manual annotation, it characterized more than 4700 individual crowns and recovered distinct vegetation patterns across geographic settings, offering a highly adaptable, low-cost baseline tool that demonstrates robust performance across the diverse multi-biome scenes within the OAM-TCD dataset.

Authors

Institutions

Publication Details

Journal
Remote Sensing
Published
2026-08-27
DOI
https://doi.org/10.3390/rs18172897
Primary Topic
Remote Sensing and LiDAR Applications
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Automating Tree Crown Delineation in UAV Orthomosaics Without Annotation: An Annotation-Free Framework Coupling DeepForest, Segment Anything, and Unsupervised Clustering

Ge Shi, Jiantao Shi, Haoran Tang, Wei Wang et al.
Remote Sensing
Remote Sensing and LiDAR Applications
article

Automating Tree Crown Delineation in UAV Orthomosaics Without Annotation: An Annotation-Free Framework Coupling DeepForest, Segment Anything, and Unsupervised Clustering

Ge Shi, Jiantao Shi, Haoran Tang, Wei Wang, Chuang Chen
article en

Abstract

Individual-tree-level information on crown distribution and morphology underpins forest inventory, biomass estimation, and carbon accounting. High-resolution Unmanned Aerial Vehicle (UAV) imagery resolves single-tree detail, but automated crown extraction remains difficult: fully supervised segmentation depends on costly pixel-level annotation that generalizes poorly, while the Segment Anything Model (SAM), though training-free, cannot locate trees on its own and existing SAM-based methods restore this ability only by adding task-specific training. We present an end-to-end, annotation-free toolkit for tree crown extraction and ecological analysis. A RetinaNet-based DeepForest detector produces coarse boxes; an adaptive module then removes duplicate boxes and non-vegetation false positives using an intersection-over-union rule and a global greenness index, converting noisy boxes into clean prompts; these prompts drive SAM to decode irregular crown masks without task-specific training; and geometric and texture features are extracted and grouped by principal component analysis and K-means clustering to map ecological patterns. We evaluated the toolkit on multi-biome imagery from the public OAM-TCD dataset. Because pixel-exact metrics are unstable at 10 cm resolution, where wind sway, shadow shift, and small labeling offsets are strongly amplified, we assessed accuracy under an absolute physical-distance tolerance. At a 2.0 m tolerance, consistent with the effective radius of a mature crown, the toolkit reached a precision of 91.25%, a recall of 86.40%, and an F1-score of 88.76%; bootstrap and Monte Carlo resampling confirmed these values are stable. Without manual annotation, it characterized more than 4700 individual crowns and recovered distinct vegetation patterns across geographic settings, offering a highly adaptable, low-cost baseline tool that demonstrates robust performance across the diverse multi-biome scenes within the OAM-TCD dataset.

Remote SensingVol. 18(17)
Nanjing Tech University (CN), University of Wisconsin–Madison (US)
Life in Land
Openalex Percentile: Top 16%
Remote Sensing and LiDAR Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.