A novel potential outlier recognition approach considering local heterogeneity enhancement to improve the quality of soil datasets
• Local heterogeneity enhancement was considered to improve LISA. • Various variability levels in different soil regions were balanced. • It provides a new mode of outlier recognition. • It can be applied to soil samples and soil map products for improvement of their quality. • It is likely to recognize more accurate abnormal soil locations in soil datasets. Soil datasets, including soil sample data and soil map products, often contain outliers that can lead to inaccurate modeling and analysis of various soil-related issues. Existing methods for identifying potential outliers in soil datasets rely on simple statistical approaches and tend to overlook the geographical characteristics of the soil. Local indicators of spatial association (LISA) can address this limitation by examining the local spatial structures inherent in soil data. However, distinguishing some outliers remains challenging because of the varying levels of heterogeneity across different soil regions. In this paper, we present a novel method for recognizing potential outliers through local heterogeneity enhancement, which is aimed at improving the quality of soil datasets. In this method, stratified soil variations are first balanced to mitigate the effects of spatial discrepancies in different soil regions. Second, local heterogeneity enhancement is conducted to modify the outlier scores associated with abnormal soils exhibiting low heterogeneity. Third, a frequency histogram of outlier scores is applied to determine a suitable threshold at which to recognize potential abnormal values in soil datasets. To validate the proposed method, it was compared with the LISA and box-plot methods. Simulation data and soil data were adopted in the experiment, incorporating two types of irregular points and spatially continuous surfaces. The comparative experiments demonstrated that the proposed method more effectively identifies potential outliers by analyzing and balancing the local spatial structure of the soil than traditional methods do. It can be concluded that local heterogeneity enhancement is beneficial for recognizing potential outliers in soil datasets.
Authors
- Mingjun Yang
- Yanjun Ye (ORCID: https://orcid.org/0000-0001-7983-6449)
- Meizi Wang (ORCID: https://orcid.org/0000-0001-9591-5753)
- Yongji Wang
- Shuhao Yuan (ORCID: https://orcid.org/0000-0003-0494-8627)
- Shaoqi Li (ORCID: https://orcid.org/0000-0001-6375-1096)
- Qingwen Qi (ORCID: https://orcid.org/0000-0002-3806-3678)
- Zihan Wang (ORCID: https://orcid.org/0000-0001-8611-3679)
- Jipeng Zhang (ORCID: https://orcid.org/0000-0002-3269-6992)
- Jiayang Lv
Institutions
- Hebei University of Engineering (CN)
- Chinese Academy of Sciences (CN)
- Zhengzhou University (CN)
- Institute of Geographic Sciences and Natural Resources Research (CN)
- University of Chinese Academy of Sciences (CN)
- Henan Agricultural University (CN)
Publication Details
- Journal
- Geoderma
- Published
- 2025-02-01
- DOI
- https://doi.org/10.1016/j.geoderma.2025.117200
- Citations
- 2
- Primary Topic
- Soil Geostatistics and Mapping
- Type
- article
- Field-Weighted Citation Impact
- 1.60