Local Feature Relevance in Full-Covariance Gaussian Mixture Models via Penalized Classification EM

Abstract In clustering by mixture models, relevant features are often cluster-specific and correlated within each group. Existing methods force an uncomfortable compromise: they either assume conditional independence to select features locally, or retain full covariances at the expense of a single global feature subset. We resolve this dilemma with a Full-Covariance Gaussian Mixture Model with Local Feature Relevance (FC-GMM-LFR). Each observation is governed by its own binary activation profile: active features follow the cluster's full-covariance Gaussian distribution, inactive features follow a shared background distribution, and a null profile naturally isolates non-informative observations. Because feature relevance is not identifiable from the likelihood alone, we select cluster-specific supports through a penalized classification criterion. We maximize this criterion with a monotone block coordinate ascent algorithm that classifies individual profiles, updates full covariances via a missing-data EM step under spectral regularization, and alternates with background estimation. In simulations, our method reliably recovers local active structures and outperforms competitors when clusters differ by their correlations. On sorted single-cell blood data, it accurately separates cell populations (ARI = 0.96), and its estimated activation rates closely reproduce the detection rates of marker genes.

Authors

Institutions

Publication Details

Journal
Research Square
Published
2026-11-17
DOI
https://doi.org/10.21203/rs.3.rs-11758566/v1
Primary Topic
Bayesian Methods and Mixture Models
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
preprint

Local Feature Relevance in Full-Covariance Gaussian Mixture Models via Penalized Classification EM

Wilson Toussile, Siméon Fotso
Research Square
Bayesian Methods and Mixture Models
preprint

Local Feature Relevance in Full-Covariance Gaussian Mixture Models via Penalized Classification EM

Wilson Toussile, Siméon Fotso
preprint en

Abstract

Abstract In clustering by mixture models, relevant features are often cluster-specific and correlated within each group. Existing methods force an uncomfortable compromise: they either assume conditional independence to select features locally, or retain full covariances at the expense of a single global feature subset. We resolve this dilemma with a Full-Covariance Gaussian Mixture Model with Local Feature Relevance (FC-GMM-LFR). Each observation is governed by its own binary activation profile: active features follow the cluster's full-covariance Gaussian distribution, inactive features follow a shared background distribution, and a null profile naturally isolates non-informative observations. Because feature relevance is not identifiable from the likelihood alone, we select cluster-specific supports through a penalized classification criterion. We maximize this criterion with a monotone block coordinate ascent algorithm that classifies individual profiles, updates full covariances via a missing-data EM step under spectral regularization, and alternates with background estimation. In simulations, our method reliably recovers local active structures and outperforms competitors when clusters differ by their correlations. On sorted single-cell blood data, it accurately separates cell populations (ARI = 0.96), and its estimated activation rates closely reproduce the detection rates of marker genes.

Research Square
Université de Yaoundé I (CM), National Advanced School of Public Works (CM)
Bayesian Methods and Mixture Models
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon