Regularization and dimensionality reduction techniques for pattern detection in GitHub repositories.
In the constant pursuit of improving the efficiency of machine learning models, various strategies have been employed to tackle the challenges related to the complexity and simplicity of datasets. Identifying the features that impact machine learning models or algorithms is essential. Avoiding overfitting is crucial, as it can result in irrelevant variables, increased computational cost, and generation of missing values that introduce significant biases, affecting the predictive capacity. A thorough evaluation of various machine learning algorithms was conducted to build an efficient predictive model, focusing on error reduction. Algorithms such as PCA, IPCA, and KPCA were compared, along with regularization methods such as Linear, Lasso, Ridge, and Elastic Net to improve model accuracy. The analysis was carried out using a large dataset that encompasses all repositories on GitHub, providing a comprehensive representation of the information needed for the comparison and evaluation of the aforementioned algorithms. The results obtained offer crucial insights for the continuous optimization of the model, with an exclusive focus on the context of GitHub. The metrics used to analyze software projects in repositories such as GitHub provide an overview of the state and dynamics of a project in terms of activity, participation, and code quality. These metrics are fundamental for making informed decisions about software management and development. Identifying the features that impact machine learning models and evaluating various algorithms and regularization methods allow for the construction of efficient predictive models that can be applied in various areas of the software industry.
Institutions
- Escuela Superior Politécnica del Chimborazo (EC)
- Universidad Nacional de Chimborazo (EC)
Publication Details
- Published
- 2024-08-21
- DOI
- https://doi.org/10.1109/colcom62950.2024.10720328
- Primary Topic
- Software Engineering Research
- Type
- article
- Field-Weighted Citation Impact
- 0.00