Solving missing categorical data in questionnaire responses for automated classification

Handling missing categorical data is critical for maintaining the accuracy and reliability of automatic classification tasks, particularly in mental health screening based on questionnaire responses. This study investigates several imputation methods, including last observation carried forward (LOCF), k-nearest neighbor (KNN) imputation, hot-deck imputation, and multivariate imputation by chained equations (MICE). Results show that KNN imputation achieves the lowest root mean square error (RMSE), indicating the most faithful reconstruction of the original data. However, for classification performance, MICE-imputed datasets produced models that outperformed those generated by other methods and even surpassed models trained on the original incomplete data. Interestingly, we also found that using observed data over multiple iterations of imputation tuning can introduce greater deviation from original missing values, but this process can help form datasets with clearer class boundaries, ultimately improving classification accuracy. These findings emphasize the need to balance data fidelity and model performance when selecting imputation strategies.

Authors

Institutions

Publication Details

Journal
Bulletin of Electrical Engineering and Informatics
Published
2025-08-01
DOI
https://doi.org/10.11591/eei.v14i4.8785
Primary Topic
Statistical Methods and Bayesian Inference
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Solving missing categorical data in questionnaire responses for automated classification

Siranuch Hemtanon, Saifon Aekwarangkoon, Thanatep Namponwatthanakul, Adisorn Amonwet
Bulletin of Electrical Engineering and Informatics
Statistical Methods and Bayesian Inference
article

Solving missing categorical data in questionnaire responses for automated classification

Siranuch Hemtanon, Saifon Aekwarangkoon, Thanatep Namponwatthanakul, Adisorn Amonwet
article en

Abstract

Handling missing categorical data is critical for maintaining the accuracy and reliability of automatic classification tasks, particularly in mental health screening based on questionnaire responses. This study investigates several imputation methods, including last observation carried forward (LOCF), k-nearest neighbor (KNN) imputation, hot-deck imputation, and multivariate imputation by chained equations (MICE). Results show that KNN imputation achieves the lowest root mean square error (RMSE), indicating the most faithful reconstruction of the original data. However, for classification performance, MICE-imputed datasets produced models that outperformed those generated by other methods and even surpassed models trained on the original incomplete data. Interestingly, we also found that using observed data over multiple iterations of imputation tuning can introduce greater deviation from original missing values, but this process can help form datasets with clearer class boundaries, ultimately improving classification accuracy. These findings emphasize the need to balance data fidelity and model performance when selecting imputation strategies.

Bulletin of Electrical Engineering and InformaticsVol. 14(4)
Nakhon Si Thammarat Rajabhat University (TH), Rajamangala University of Technology Srivijaya (TH), Walailak University (TH)
Openalex Percentile: Top 81%
Statistical Methods and Bayesian Inference
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Solving missing categorical data in questionnaire responses for automated classification — Siranuch Hemtanon, Saifon Aekwarangkoon, et al. · Bulletin of Electrical Engineering and Informatics (2025) | TGRS Research Map | TGRS