Comprehensive Data Corruption Identification Using Machine Learning Algorithms (PAACDA)

Data and analysis have evolved from being scattered numbers and qualities in spreadsheets to being seen as a means to revolutionize any substantial industry, thanks to the rise of technology. There are many unethical and unlawful ways that data may get corrupted; thus, it's important to find a way to effectively detect and highlight all the corrupted data in the dataset. It is not an easy task to detect damaged data or to restore information from a corrupted dataset. This is crucial and could cause issues with data processing using machines or deep learning methods later on if not handled early enough. Rather than focusing on outlier identification, this study introduces its PAACDA: Presence-driven Adamic Adar Corruption Identification Algorithm and then consolidates the findings. Even though they rely on parameter tuning to achieve high accuracy, and remember, current state-of-the-art models like Isolation Forest and DBSCAN (which stands for "Density-Based the Spatial Process of Clustering of the Applications with Noise") have a lot of uncertainty when they factor in corrupted data. This study investigates the specific performance problems with several unsupervised learning methods on corrupted linear and clustered datasets. In addition, we provide a new PAACDA technique that achieves a higher precision of 96.35% for cluster data and 99.04% for linear data compared to previous unsupervised training benchmarks on 15 prominent baselines, including K-means clustering, isolation forest, and LOF (local outlier factor). From the aforementioned angles, this essay delves deeply into the relevant literature as well. In this study, we identify all the problems with current methods and suggest ways forward for research in this area.

Authors

Institutions

Publication Details

Journal
Turkish Journal of Computer and Mathematics Education (TURCOMAT).
Published
2024-09-04
DOI
https://doi.org/10.61841/turcomat.v15i3.14785
Primary Topic
Imbalanced Data Classification Techniques
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Comprehensive Data Corruption Identification Using Machine Learning Algorithms (PAACDA)

K. Maneesha, M. Vanitha, Uma Renu Sri K., K. Nancy
Turkish Journal of Computer and Mathematics Education (TURCOMAT).
Imbalanced Data Classification Techniques
article

Comprehensive Data Corruption Identification Using Machine Learning Algorithms (PAACDA)

K. Maneesha, M. Vanitha, Uma Renu Sri K., K. Nancy
article en

Abstract

Data and analysis have evolved from being scattered numbers and qualities in spreadsheets to being seen as a means to revolutionize any substantial industry, thanks to the rise of technology. There are many unethical and unlawful ways that data may get corrupted; thus, it's important to find a way to effectively detect and highlight all the corrupted data in the dataset. It is not an easy task to detect damaged data or to restore information from a corrupted dataset. This is crucial and could cause issues with data processing using machines or deep learning methods later on if not handled early enough. Rather than focusing on outlier identification, this study introduces its PAACDA: Presence-driven Adamic Adar Corruption Identification Algorithm and then consolidates the findings. Even though they rely on parameter tuning to achieve high accuracy, and remember, current state-of-the-art models like Isolation Forest and DBSCAN (which stands for "Density-Based the Spatial Process of Clustering of the Applications with Noise") have a lot of uncertainty when they factor in corrupted data. This study investigates the specific performance problems with several unsupervised learning methods on corrupted linear and clustered datasets. In addition, we provide a new PAACDA technique that achieves a higher precision of 96.35% for cluster data and 99.04% for linear data compared to previous unsupervised training benchmarks on 15 prominent baselines, including K-means clustering, isolation forest, and LOF (local outlier factor). From the aforementioned angles, this essay delves deeply into the relevant literature as well. In this study, we identify all the problems with current methods and suggest ways forward for research in this area.

Turkish Journal of Computer and Mathematics Education (TURCOMAT).Vol. 15(3)
University College for Women (IN)
Peace, Justice and strong institutions
Openalex Percentile: Top 86%
Imbalanced Data Classification Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.