TraM: Enhancing User Sleep Prediction with Transformer-Based Multivariate Time Series Modeling and Machine Learning Ensembles

This paper presents a novel approach that leverages Transformer-based multivariate time series model and Machine Learning Ensembles to predict the quality of human sleep, emotional states, and stress levels. A formula to calculate the labels was developed, and the various models were applied to user data. Time Series Transformer was used for labels where time series characteristics are crucial, while Machine Learning Ensembles was employed for labels requiring comprehensive daily activity statistics. Time Series Transformer excels at capturing the characteristics of time series through pre-training, while Machine Learning Ensembles selects machine learning models that meet our categorization criteria. In experiments, the proposed model, TraM, scored 6.10 out of 10, demonstrating superior performance compared to other methodologies. The code and configuration for the TraM framework are available at: https://github.com/jin-jae/ETRI-Paper-Contest.