Data Science Salary Prediction: A Comparative Study of Standard Regressors and Leakage Testing

This study presents a comparative analysis of standard regression models for predicting data science salaries, with a specific focus on identifying and testing for data leakage—a frequent cause of over-optimistic results in applied data mining.The dataset comprises 3,761 records describing data science positions, featuring variables such as work year, experience level (entry, mid, senior, executive), employment type, job title, company location, company size, and salary converted to US dollars.The methodology involves preprocessing the data through one-hot encoding of categorical features and evaluating the models under different experimental settings to explicitly test for target leakage. The study highlights that the dataset is heavily skewed toward senior, full-time, and US-based positions, which may affect the reliability of predictions for other demographics.Key contributions include:A side-by-side comparison of standard regressors using default hyperparameters.An explicit evaluation of data leakage in the prediction pipeline.An exploratory analysis of the dataset's characteristics and feature distributions.The study also outlines future work, which includes grouping similar job titles into role families, applying a log transformation to the skewed target variable, tuning hyperparameters with cross-validation, evaluating gradient boosting libraries such as XGBoost, and adding features such as remote-work ratio, industry, and required skills.

Authors

Publication Details

Journal
Figshare
Published
2026-10-28
DOI
https://doi.org/10.6084/m9.figshare.34823334
Primary Topic
Data Mining and Machine Learning Applications
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
preprint

Data Science Salary Prediction: A Comparative Study of Standard Regressors and Leakage Testing

Sareena Bilal
1 links
Figshare
Data Mining and Machine Learning Applications
preprint

Data Science Salary Prediction: A Comparative Study of Standard Regressors and Leakage Testing

Sareena Bilal
preprint en

Abstract

This study presents a comparative analysis of standard regression models for predicting data science salaries, with a specific focus on identifying and testing for data leakage—a frequent cause of over-optimistic results in applied data mining.The dataset comprises 3,761 records describing data science positions, featuring variables such as work year, experience level (entry, mid, senior, executive), employment type, job title, company location, company size, and salary converted to US dollars.The methodology involves preprocessing the data through one-hot encoding of categorical features and evaluating the models under different experimental settings to explicitly test for target leakage. The study highlights that the dataset is heavily skewed toward senior, full-time, and US-based positions, which may affect the reliability of predictions for other demographics.Key contributions include:A side-by-side comparison of standard regressors using default hyperparameters.An explicit evaluation of data leakage in the prediction pipeline.An exploratory analysis of the dataset's characteristics and feature distributions.The study also outlines future work, which includes grouping similar job titles into role families, applying a log transformation to the skewed target variable, tuning hyperparameters with cross-validation, evaluating gradient boosting libraries such as XGBoost, and adding features such as remote-work ratio, industry, and required skills.

Figshare
Reduced inequalities
Data Mining and Machine Learning Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon