The modified external parameter orthogonalization with removed PC2 to remove effectively the moisture effect on the spectra

• The modified EPO make the variance of spectra mainly on PC1. • EPO mis-correct near the 1400 and 1900 nm wavelengths. • The removal of PC2 had positively affect and improved the accuracy on predicting SOM. • The PC needed to remove can be selected using the PCA biplots. In situ visible–near infrared spectroscopy holds great potential in providing information supporting field applications, decision making and management in soil science, especially combined with the information present in the archived soil spectra. However, soil moisture can drastically affect the reflectance curve and reduce prediction accuracy. The external parameter orthogonalization (EPO) can remove the moisture effect but the effect of elimination is urgently needed to be improved. Herein, firstly, we implemented EPO on 50 bootstrapped calibration datasets, which generated from the local soil spectra library, with 255 combinations of PC 1 to PC 8 , resulting in a total of 50*255 models in PLSR and cubist, respectively. Secondly, we calculated the mean prediction results from these 255 combinations and selected the top 10 validation performance results. Thirdly, we performed correlation analysis on SOM with each segment induced by singular value decomposition on the difference of laboratory and in situ spectra to determine which PC should be removed in the modified EPO. Results revealed that top 10 prediction results with principles without PC 2 and the moisture effect was mainly in PC 1 , and PC 2 with significant correlation with SOM were removed from the EPO procedure. EPO with removing PC 2 (namely Modified EPO) improved the correlation of SOM with some optional bands that directly and indirectly were associated with SOM to improve the SOM prediction accuracy. Modified EPO improved the accuracy in predicting SOM with increased R 2 (9 %–44 % and 7 %–17 %) and root mean square error (1 %–9 % and 63 %–68 %) in the PLSR and Cubist model, respectively. Our study highlights the advantage of modified EPO in improving the elimination efficiency of water in spectra, and of PC analysis biplots in approximating the removed PCs.

Authors

Institutions

Publication Details

Journal
Geoderma
Published
2024-09-30
DOI
https://doi.org/10.1016/j.geoderma.2024.117051
Citations
2
Primary Topic
Soil Geostatistics and Mapping
Type
article
Field-Weighted Citation Impact
0.41
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

The modified external parameter orthogonalization with removed PC2 to remove effectively the moisture effect on the spectra

Meihua Yang, Zhi Long Zhang, Xiaomin Zhao, Songchao Chen et al.
2 citations
Geoderma
Soil Geostatistics and Mapping
0.41
article

The modified external parameter orthogonalization with removed PC2 to remove effectively the moisture effect on the spectra

Meihua Yang, Zhi Long Zhang, Xiaomin Zhao, Songchao Chen, Yongsheng Hong, Zhou Shi
article en
2 citations

Abstract

• The modified EPO make the variance of spectra mainly on PC1. • EPO mis-correct near the 1400 and 1900 nm wavelengths. • The removal of PC2 had positively affect and improved the accuracy on predicting SOM. • The PC needed to remove can be selected using the PCA biplots. In situ visible–near infrared spectroscopy holds great potential in providing information supporting field applications, decision making and management in soil science, especially combined with the information present in the archived soil spectra. However, soil moisture can drastically affect the reflectance curve and reduce prediction accuracy. The external parameter orthogonalization (EPO) can remove the moisture effect but the effect of elimination is urgently needed to be improved. Herein, firstly, we implemented EPO on 50 bootstrapped calibration datasets, which generated from the local soil spectra library, with 255 combinations of PC 1 to PC 8 , resulting in a total of 50*255 models in PLSR and cubist, respectively. Secondly, we calculated the mean prediction results from these 255 combinations and selected the top 10 validation performance results. Thirdly, we performed correlation analysis on SOM with each segment induced by singular value decomposition on the difference of laboratory and in situ spectra to determine which PC should be removed in the modified EPO. Results revealed that top 10 prediction results with principles without PC 2 and the moisture effect was mainly in PC 1 , and PC 2 with significant correlation with SOM were removed from the EPO procedure. EPO with removing PC 2 (namely Modified EPO) improved the correlation of SOM with some optional bands that directly and indirectly were associated with SOM to improve the SOM prediction accuracy. Modified EPO improved the accuracy in predicting SOM with increased R 2 (9 %–44 % and 7 %–17 %) and root mean square error (1 %–9 % and 63 %–68 %) in the PLSR and Cubist model, respectively. Our study highlights the advantage of modified EPO in improving the elimination efficiency of water in spectra, and of PC analysis biplots in approximating the removed PCs.

GeodermaVol. 450
Nanchang University (CN), Institute of Soil Science (CN), Yuzhang Normal University, Jiangxi Agricultural University (CN), Zhejiang University (CN)
Openalex Percentile: Top 41%
Soil Geostatistics and Mapping
0.41
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.