A Machine Learning Approach on Outlier Removal for Decision Tree Regression Method

Outliers can occur in application areas, adversely affecting the prediction method's performance.Outliers can be removed by using robust statistical algorithms.However, statistical methods have limitations in capturing the outlier for high-dimensional data.Approaches using Machine Learning (ML) are offered as they develop rapidly due to their excellent interpretability and strong generalization capabilities.So, ML is popular in detecting or eliminating outliers to increase the accuracy of forecasting methods, such as Isolation Forest (IF), an unsupervised outlier detection strategy using a collective approach to calculate the isolation score for every data point.This research objective is to improve the prediction accuracy of the Decision Tree Regression (DTR) method by proposing an IF as an ML-based outlier removal method.The proposed method was tested by two Air Quality Index (AQI) dataset that contained outliers with Mean Absolute Error (MAE), R-Square, and Root Mean Square Error (RMSE) as the accuracy measurements.The results showed that the proposed method outperforms previous studies.

Authors

Institutions

Publication Details

Journal
Ingénierie des systèmes d information
Published
2024-08-21
DOI
https://doi.org/10.18280/isi.290414
Citations
1
Primary Topic
Anomaly Detection Techniques and Applications
Type
article
Field-Weighted Citation Impact
0.35

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A Machine Learning Approach on Outlier Removal for Decision Tree Regression Method

Erwin Eko Wahyudi, Agus Sihabuddin, Nur Rokhman
1 citations
Ingénierie des systèmes d information
Anomaly Detection Techniques and Applications
0.35
article

A Machine Learning Approach on Outlier Removal for Decision Tree Regression Method

Erwin Eko Wahyudi, Agus Sihabuddin, Nur Rokhman
article en
1 citations

Abstract

Outliers can occur in application areas, adversely affecting the prediction method's performance.Outliers can be removed by using robust statistical algorithms.However, statistical methods have limitations in capturing the outlier for high-dimensional data.Approaches using Machine Learning (ML) are offered as they develop rapidly due to their excellent interpretability and strong generalization capabilities.So, ML is popular in detecting or eliminating outliers to increase the accuracy of forecasting methods, such as Isolation Forest (IF), an unsupervised outlier detection strategy using a collective approach to calculate the isolation score for every data point.This research objective is to improve the prediction accuracy of the Decision Tree Regression (DTR) method by proposing an IF as an ML-based outlier removal method.The proposed method was tested by two Air Quality Index (AQI) dataset that contained outliers with Mean Absolute Error (MAE), R-Square, and Root Mean Square Error (RMSE) as the accuracy measurements.The results showed that the proposed method outperforms previous studies.

Ingénierie des systèmes d informationVol. 29(4)
Universitas Gadjah Mada (ID)
Universitas Gadjah Mada
Reduced inequalities
Openalex Percentile: Top 35%
Anomaly Detection Techniques and Applications
0.35
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.