Leveraging PCA to reduce Complexity and Converge Accuracy When Predicting Illnes
High-dimensional datasets often pose challenges for machine learning models, including increased computational complexity, noise, and the curse of dimensionality. Principal component analysis (PCA) is a well-established technique for dimensionality reduction that addresses these issues by projecting the data into a lower-dimensional space while retaining most of the variance. In this project, we set out to build a baseline neural network model in order to establish a performance benchmark on the high-dimensional dataset. Subsequently, PCA is applied to reduce the dimensionality of the input features, mitigating noise and improving efficiency during inference. The resulting low-dimensional representation is used to train a second neural network, demonstrating the trade-offs between dimensionality reduction, model complexity, and predictive performance. This approach highlights the synergy between PCA and neural networks for efficient and robust modeling in highdimensional settings
Institutions
- Indiana University – Purdue University Indianapolis (US)
Publication Details
- Journal
- Zenodo (CERN European Organization for Nuclear Research)
- Published
- 2025-08-17
- DOI
- https://doi.org/10.5281/zenodo.16888096
- Primary Topic
- Big Data and Digital Economy
- Type
- article
- Field-Weighted Citation Impact
- 0.00