Automated curation of spatial metadata in environmental monitoring data
Spatial data accuracy in environmental monitoring is crucial for practical large-scale data analytics and the development of AI models. In this context, spatial data is metadata and faces the same challenges as any other metadata, like missing values, false or contradicting information, formatting problems of textual data and numbers, the usage of different languages, and more. These issues severely limit the usability of the data. With this study, we provide an automatic approach, CleanGeoStreamR, to resolve as many of these issues as possible for the spatially annotated environmental monitoring database. We substantially increased the quality of the spatial metadata and, therefore, the quantity of data points that can be used in large-scale data analytics and AI applications. Further, our goal is to raise awareness about the issues related to spatial metadata and promote the implementation of our concepts in other environmental monitoring data sources. Advanced understanding and the availability of automatic approaches like the presented method will substantially contribute to making environmental monitoring data FAIR and enhance its usability in the era of Big Data and AI. • Enhance the NORMAN database with 92 million chemical occurrence data points. • Normalize metadata to address language, typos, and decimal separator issues. • Fill 36 % of data gaps, resolving over 107 million missing values. • Develop an R package to resolve issues regarding geospatial data in an automated way. • Tag and resolve inconsistencies for Big Data analytics and AI applications.
Authors
- İlhan Mutlu (ORCID: https://orcid.org/0000-0001-8995-6671)
- Jana Schor (ORCID: https://orcid.org/0000-0003-1200-6234)
- Jörg Hackermüller (ORCID: https://orcid.org/0000-0003-4920-7072)
Institutions
- Helmholtz Centre for Environmental Research (DE)
- Leipzig University of Applied Sciences (DE)
- Leipzig University (DE)
Publication Details
- Journal
- Ecological Informatics
- Published
- 2025-01-27
- DOI
- https://doi.org/10.1016/j.ecoinf.2025.103038
- Citations
- 1
- Primary Topic
- Geographic Information Systems Studies
- Type
- article
- Field-Weighted Citation Impact
- 6.72
Funders
- Helmholtz Association