Effective Data Preprocessing in Data Science: From Method Selection to Domain-Specific Optimization

In the era of big data and artificial intelligence, data preprocessing has emerged as a critical step in the data science pipeline, influencing the quality, performance, and reliability of machine learning models. Despite its importance, the diversity of techniques, challenges, and evolving practices necessitate a structured understanding of this domain. This study conducts a systematic literature review (SLR) to explore current data preprocessing techniques, their domain-specific applications, associated challenges, and emerging trends. A total of 21 peer-reviewed articles from 2016 to 2024 were analyzed using well-defined inclusion and exclusion criteria, with a focus on machine learning and big data contexts. The results reveal that normalization, data cleaning, feature selection, and dimensionality reduction are the most commonly applied techniques. Key challenges identified include handling missing values, high dimensionality, and imbalanced data. Moreover, recent trends such as automated preprocessing (AutoML), privacy-preserving methods, and scalable preprocessing for distributed systems are gaining momentum. The review concludes that while traditional methods remain foundational, there is a shift toward adaptive and intelligent preprocessing strategies to meet the growing complexity of data environments. This study offers valuable insights for researchers and practitioners aiming to optimize data preparation processes in modern data science workflows

Authors

Institutions

Publication Details

Journal
Journal of Advanced Computer Knowledge and Algorithms
Published
2025-07-12
DOI
https://doi.org/10.29103/jacka.v2i4.22886
Citations
1
Primary Topic
Machine Learning and Data Classification
Type
article
Field-Weighted Citation Impact
2.48
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Effective Data Preprocessing in Data Science: From Method Selection to Domain-Specific Optimization

Hafizullah Shahbazi, Shahwali Shahidi, Abdul Wahid Samadzai
1 citations
Journal of Advanced Computer Knowledge and Algorithms
Machine Learning and Data Classification
2.48
article

Effective Data Preprocessing in Data Science: From Method Selection to Domain-Specific Optimization

Hafizullah Shahbazi, Shahwali Shahidi, Abdul Wahid Samadzai
article en
1 citations

Abstract

In the era of big data and artificial intelligence, data preprocessing has emerged as a critical step in the data science pipeline, influencing the quality, performance, and reliability of machine learning models. Despite its importance, the diversity of techniques, challenges, and evolving practices necessitate a structured understanding of this domain. This study conducts a systematic literature review (SLR) to explore current data preprocessing techniques, their domain-specific applications, associated challenges, and emerging trends. A total of 21 peer-reviewed articles from 2016 to 2024 were analyzed using well-defined inclusion and exclusion criteria, with a focus on machine learning and big data contexts. The results reveal that normalization, data cleaning, feature selection, and dimensionality reduction are the most commonly applied techniques. Key challenges identified include handling missing values, high dimensionality, and imbalanced data. Moreover, recent trends such as automated preprocessing (AutoML), privacy-preserving methods, and scalable preprocessing for distributed systems are gaining momentum. The review concludes that while traditional methods remain foundational, there is a shift toward adaptive and intelligent preprocessing strategies to meet the growing complexity of data environments. This study offers valuable insights for researchers and practitioners aiming to optimize data preparation processes in modern data science workflows

Journal of Advanced Computer Knowledge and AlgorithmsVol. 2(4)
Kabul University (AF), Kabul Education University (AF)
Openalex Percentile: Top 8%
Machine Learning and Data Classification
2.48
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.