Developing and Evaluating a Classification Model for Construction Defect Control: A Text Mining and Ensemble Learning Approach

In the construction industry, customer satisfaction is of paramount importance, as it significantly impacts company success and reputation. In Korea’s competitive apartment market, customer satisfaction—particularly feedback on newly built apartments—is vital for construction companies, as it fosters growth and customer loyalty. To gain an understanding of the sentiments and patterns within this feedback, text mining can be utilized. This study aims to extract such insights from textual data on apartment building defect complaints, using text mining and ensemble learning to develop models with high prediction accuracy. It analyzes the accuracy of the Word2Vec and term frequency–inverse document frequency (TF-IDF) models, as well as the individual performance of different classification models, including naïve Bayes, decision trees, logistic regression, k-nearest neighbors, support vector machines (SVMs), and random forests. This analysis was conducted to validate the effectiveness of ensemble learning. Data were collected from a total of 230 apartment building projects in South Korea between 2018 and 2023, resulting in a data set of 101,387 data points, which underwent analysis to validate the model. The validation results consistently showed that TF-IDF outperforms Word2Vec, with the SVM model achieving the highest performance, attaining an average F1 score of 0.7439. Ensemble learning models demonstrated an improvement in accuracy of up to 34% over single models, reaching an average accuracy of 97.47% after the removal of human error. While this study acknowledges its limitations, which include potential biases in the data set, the impact of language evolution on model precision, and difficulties in classifying complex defects, the ensemble model demonstrated substantial improvements in defect classification accuracy and provided practical insights for defect management in construction. Moving forward, future work could explore integrating multidimensional data, utilizing speech-to-text technology, prioritizing defects by severity, and employing artificial intelligence for real-time defect prediction to further enhance defect management practices.

Authors

Institutions

Publication Details

Journal
Journal of Management in Engineering
Published
2024-12-04
DOI
https://doi.org/10.1061/jmenea.meeng-6296
Citations
6
Primary Topic
BIM and Construction Integration
Type
article
Field-Weighted Citation Impact
1.59
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Developing and Evaluating a Classification Model for Construction Defect Control: A Text Mining and Ensemble Learning Approach

Lei Hou, Jae-Jun Kim, SangHyeok Han, Sungkon Moon et al.
6 citations
Journal of Management in Engineering
BIM and Construction Integration
1.59
article

Developing and Evaluating a Classification Model for Construction Defect Control: A Text Mining and Ensemble Learning Approach

Lei Hou, Jae-Jun Kim, SangHyeok Han, Sungkon Moon, Inho Jo
article en
6 citations

Abstract

In the construction industry, customer satisfaction is of paramount importance, as it significantly impacts company success and reputation. In Korea’s competitive apartment market, customer satisfaction—particularly feedback on newly built apartments—is vital for construction companies, as it fosters growth and customer loyalty. To gain an understanding of the sentiments and patterns within this feedback, text mining can be utilized. This study aims to extract such insights from textual data on apartment building defect complaints, using text mining and ensemble learning to develop models with high prediction accuracy. It analyzes the accuracy of the Word2Vec and term frequency–inverse document frequency (TF-IDF) models, as well as the individual performance of different classification models, including naïve Bayes, decision trees, logistic regression, k-nearest neighbors, support vector machines (SVMs), and random forests. This analysis was conducted to validate the effectiveness of ensemble learning. Data were collected from a total of 230 apartment building projects in South Korea between 2018 and 2023, resulting in a data set of 101,387 data points, which underwent analysis to validate the model. The validation results consistently showed that TF-IDF outperforms Word2Vec, with the SVM model achieving the highest performance, attaining an average F1 score of 0.7439. Ensemble learning models demonstrated an improvement in accuracy of up to 34% over single models, reaching an average accuracy of 97.47% after the removal of human error. While this study acknowledges its limitations, which include potential biases in the data set, the impact of language evolution on model precision, and difficulties in classifying complex defects, the ensemble model demonstrated substantial improvements in defect classification accuracy and provided practical insights for defect management in construction. Moving forward, future work could explore integrating multidimensional data, utilizing speech-to-text technology, prioritizing defects by severity, and employing artificial intelligence for real-time defect prediction to further enhance defect management practices.

Journal of Management in EngineeringVol. 41(2)
MIT University (MK), Concordia University (US), Hanyang University (KR), Ajou University (KR)
Openalex Percentile: Top 18%
BIM and Construction Integration
1.59
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.