Enhancing model robustness to imbalanced species abundance distributions: Eliminating misclassified records via a model-agnostic approach, exemplified by tuna fisheries datasets

Anomalies in species abundance data can potentially cause classification errors in ecological forecasting models. Accurate estimation of anomalies locations can enhance the predictive capacity of models. This study aims to propose an approach for precisely identifying and correcting anomalies within imbalanced species abundance data, thereby addressing the challenges posed by both anomalous and imbalanced species abundance distributions (SADs). A model-agnostic statistical tool, Confident Learning (CL) theory, is introduced to estimate the probability of each sample being misclassified during the prediction phase. Specifically, the approach targets classification errors from models trained on imbalanced SADs for data-cleansing, identifying these records as anomalies. The approach is applied to tuna fisheries datasets, focusing specifically on bigeye tuna ( Thunnus obesus ), a targeted species in longline fishing, and albacore tuna ( Thunnus alalunga ), a non-target species in the tropical Atlantic Ocean. These datasets, spanning from 2016 to 2019, featured a spatial resolution of 0.5° × 0.5° and daily temporal resolution, providing a comprehensive view of imbalanced data scenarios. The results demonstrate that all the predictors: Support Vector Machine (SVM), Logistic Regression (LR), Random Forests (RF), and Extreme Gradient Boosting (XGBoost) were considerably enhanced after training on the cleaned datasets. Notably, SVM and LR achieved overall accuracy rates of over 90% on predicting both low- and high-abundant fishing grounds. The proposed approach reveals that the elimination of anomalies can enhance the robustness of ecological forecasting models to imbalanced SADs, offering new insights and technical support for the delicate prediction and assessment of ecological resources. • Identifies and cleans anomalies in imbalanced catch data. • Confident Learning theory was used to assess misclassification risks. • Zero-catches is neither a sufficient nor a necessary condition for anomalies. • Cleaned training datasets improve models performance by 15 ∼ 40%. • Anomalies elimination boosts model robustness to imbalanced catch data.

Authors

Publication Details

Journal
Ecological Informatics
Published
2024-11-23
DOI
https://doi.org/10.1016/j.ecoinf.2024.102905
Citations
3
Primary Topic
Fish Ecology and Management Studies
Type
article
Field-Weighted Citation Impact
2.07
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Enhancing model robustness to imbalanced species abundance distributions: Eliminating misclassified records via a model-agnostic approach, exemplified by tuna fisheries datasets

Liming Song, Tianjiao Zhang, Zhexuan Li
3 citations
Ecological Informatics
Fish Ecology and Management Studies
2.07
article

Enhancing model robustness to imbalanced species abundance distributions: Eliminating misclassified records via a model-agnostic approach, exemplified by tuna fisheries datasets

Liming Song, Tianjiao Zhang, Zhexuan Li
article en
3 citations

Abstract

Anomalies in species abundance data can potentially cause classification errors in ecological forecasting models. Accurate estimation of anomalies locations can enhance the predictive capacity of models. This study aims to propose an approach for precisely identifying and correcting anomalies within imbalanced species abundance data, thereby addressing the challenges posed by both anomalous and imbalanced species abundance distributions (SADs). A model-agnostic statistical tool, Confident Learning (CL) theory, is introduced to estimate the probability of each sample being misclassified during the prediction phase. Specifically, the approach targets classification errors from models trained on imbalanced SADs for data-cleansing, identifying these records as anomalies. The approach is applied to tuna fisheries datasets, focusing specifically on bigeye tuna ( Thunnus obesus ), a targeted species in longline fishing, and albacore tuna ( Thunnus alalunga ), a non-target species in the tropical Atlantic Ocean. These datasets, spanning from 2016 to 2019, featured a spatial resolution of 0.5° × 0.5° and daily temporal resolution, providing a comprehensive view of imbalanced data scenarios. The results demonstrate that all the predictors: Support Vector Machine (SVM), Logistic Regression (LR), Random Forests (RF), and Extreme Gradient Boosting (XGBoost) were considerably enhanced after training on the cleaned datasets. Notably, SVM and LR achieved overall accuracy rates of over 90% on predicting both low- and high-abundant fishing grounds. The proposed approach reveals that the elimination of anomalies can enhance the robustness of ecological forecasting models to imbalanced SADs, offering new insights and technical support for the delicate prediction and assessment of ecological resources. • Identifies and cleans anomalies in imbalanced catch data. • Confident Learning theory was used to assess misclassification risks. • Zero-catches is neither a sufficient nor a necessary condition for anomalies. • Cleaned training datasets improve models performance by 15 ∼ 40%. • Anomalies elimination boosts model robustness to imbalanced catch data.

Ecological InformaticsVol. 84
Life below water
Openalex Percentile: Top 13%
Fish Ecology and Management Studies
2.07
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.