A Generalized K2 Algorithm for Learning Bayesian Network Structures Using Ridge Regression

In this article, we propose a new approach of the K2 algorithm to enhance the process of selecting candidate parents in Bayesian networks by incorporating dependency criteria based on ridge regression. Traditional K2 algorithms primarily rely on scoring functions to evaluate parent sets, which may not effectively capture all dependencies in the presence of multicollinearity. Our approach leverages ridge regression to address this limitation by penalizing overly complex models, thereby providing a more robust mechanism for parent selection. Through real-world data applications, we demonstrate that our generalized algorithm significantly improves the accuracy and reliability of parent selection in Bayesian networks. The findings suggest that this integration of ridge regression with the K2 algorithm offers a promising avenue for advancing Bayesian network structure learning, particularly in complex data.

Authors

Institutions

Publication Details

Journal
Lobachevskii Journal of Mathematics
Published
2025-04-01
DOI
https://doi.org/10.1134/s1995080225606290
Primary Topic
Bayesian Modeling and Causal Inference
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A Generalized K2 Algorithm for Learning Bayesian Network Structures Using Ridge Regression

Mehryar Fallahnejad, Vahid Rezaei Tabar, Mohammad Reza Kazemi
Lobachevskii Journal of Mathematics
Bayesian Modeling and Causal Inference
article

A Generalized K2 Algorithm for Learning Bayesian Network Structures Using Ridge Regression

Mehryar Fallahnejad, Vahid Rezaei Tabar, Mohammad Reza Kazemi
article en

Abstract

In this article, we propose a new approach of the K2 algorithm to enhance the process of selecting candidate parents in Bayesian networks by incorporating dependency criteria based on ridge regression. Traditional K2 algorithms primarily rely on scoring functions to evaluate parent sets, which may not effectively capture all dependencies in the presence of multicollinearity. Our approach leverages ridge regression to address this limitation by penalizing overly complex models, thereby providing a more robust mechanism for parent selection. Through real-world data applications, we demonstrate that our generalized algorithm significantly improves the accuracy and reliability of parent selection in Bayesian networks. The findings suggest that this integration of ridge regression with the K2 algorithm offers a promising avenue for advancing Bayesian network structure learning, particularly in complex data.

Lobachevskii Journal of MathematicsVol. 46(4)
Allameh Tabataba'i University (IR), University of Guilan (IR)
Climate action
Openalex Percentile: Top 89%
Bayesian Modeling and Causal Inference
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.