House Price Prediction Using Machine Learning: Analysis of XGBoost and Gradient Boosting Models

This study investigates the optimization and application of Distributed Machine Learning (DML) techniques, essential for addressing the computational challenges of large-scale datasets in modern applications such as autonomous driving and natural language processing. The primary objective is to evaluate the performance and characteristics of key DML methods, including MapReduce, Parallelized Stochastic Gradient Descent (PSGD), and Federated Learning (FL). A comprehensive analytical framework is employed to explore the underlying mechanisms of each method. For MapReduce, the study examines data partitioning, mapping, shuffling, and reducing processes to assess its efficiency in managing large datasets. In PSGD, the research analyzes the methods of data allocation, local gradient computation, and parameter aggregation to highlight its parallelization benefits and identify potential bottlenecks. FL focuses on its privacy-preserving model training process, which includes client-server communication, local updates, and global aggregation. Experimental results using the ImageNet dataset and Gboard user log data show that while MapReduce offers fault tolerance, PSGD accelerates training on large datasets, and FL ensures data privacy. However, limitations such as communication overhead and convergence issues remain, underscoring the trade-offs between efficiency, scalability, and privacy in DML applications.