PosE-Enhanced Point Transformer with Local Surface Features (LSF) for Wood–Leaf Separation

Wood–leaf separation from forest LiDAR point clouds is a challenging task due to the complex and irregular structures of tree canopies. Traditional machine vision and deep learning methods often struggle to accurately distinguish between fine branches and leaves. This challenge arises primarily from the lack of suitable features and the limitations of existing position encodings in capturing the unique and intricate characteristics of forest point clouds. In this work, we propose an innovative approach that integrates Local Surface Features (LSF) and a Position Encoding (PosE) module within the Point Transformer (PT) network to address these challenges. We began by preprocessing point clouds and applying a machine vision technique, supplemented by manual correction, to create wood–leaf-separated datasets of forest point clouds for training. Next, we introduced Point Feature Histogram (PFH) to construct LSF for each point network input, while utilizing Fast PFH (FPFH) to enhance computational efficiency. Subsequently, we designed a PosE module within PT, leveraging trigonometric dimensionality expansion and Random Fourier Feature-based Transformation (RFFT) for nuanced feature analysis. This design significantly enhances the representational richness and precision of forest point clouds. Afterward, the segmented branch point cloud was used to model tree skeletons automatically, while the leaves were incorporated to complete the digital twin. Our enhanced network, tested on three different types of forests, achieved up to 96.23% in accuracy and 91.51% in mean intersection over union (mIoU) in wood–leaf separation, outperforming the original PT by approximately 5%. This study not only expands the limits of forest point cloud research but also demonstrates significant improvements in the reconstruction results, particularly in capturing the intricate structures of twigs, which paves the way for more accurate forest resource surveys and advanced digital twin construction.

Authors

Institutions

Publication Details

Journal
Forests
Published
2024-12-20
DOI
https://doi.org/10.3390/f15122244
Citations
3
Primary Topic
Remote Sensing and LiDAR Applications
Type
article
Field-Weighted Citation Impact
0.62

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

PosE-Enhanced Point Transformer with Local Surface Features (LSF) for Wood–Leaf Separation

Ting Yun, Huaiqing Zhang, Ji Zhou, Xin Lu et al.
3 citations
Forests
Remote Sensing and LiDAR Applications
0.62
article

PosE-Enhanced Point Transformer with Local Surface Features (LSF) for Wood–Leaf Separation

Ting Yun, Huaiqing Zhang, Ji Zhou, Xin Lu, Ruisheng Wang
article en
3 citations

Abstract

Wood–leaf separation from forest LiDAR point clouds is a challenging task due to the complex and irregular structures of tree canopies. Traditional machine vision and deep learning methods often struggle to accurately distinguish between fine branches and leaves. This challenge arises primarily from the lack of suitable features and the limitations of existing position encodings in capturing the unique and intricate characteristics of forest point clouds. In this work, we propose an innovative approach that integrates Local Surface Features (LSF) and a Position Encoding (PosE) module within the Point Transformer (PT) network to address these challenges. We began by preprocessing point clouds and applying a machine vision technique, supplemented by manual correction, to create wood–leaf-separated datasets of forest point clouds for training. Next, we introduced Point Feature Histogram (PFH) to construct LSF for each point network input, while utilizing Fast PFH (FPFH) to enhance computational efficiency. Subsequently, we designed a PosE module within PT, leveraging trigonometric dimensionality expansion and Random Fourier Feature-based Transformation (RFFT) for nuanced feature analysis. This design significantly enhances the representational richness and precision of forest point clouds. Afterward, the segmented branch point cloud was used to model tree skeletons automatically, while the leaves were incorporated to complete the digital twin. Our enhanced network, tested on three different types of forests, achieved up to 96.23% in accuracy and 91.51% in mean intersection over union (mIoU) in wood–leaf separation, outperforming the original PT by approximately 5%. This study not only expands the limits of forest point cloud research but also demonstrates significant improvements in the reconstruction results, particularly in capturing the intricate structures of twigs, which paves the way for more accurate forest resource surveys and advanced digital twin construction.

ForestsVol. 15(12)
National Institute of Agricultural Botany (GB), Nanjing Forestry University (CN), University of Calgary (CA), Institute of Forest Resource Information Techniques (CN), Chinese Academy of Forestry (CN)
Ministry of Natural Resources of the People's Republic of China, National Natural Science Foundation of China, Government of Jiangsu Province, Natural Science Foundation of Jiangsu Province, Shenzhen University
Life in Land
Openalex Percentile: Top 34%
Remote Sensing and LiDAR Applications
0.62
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.