A Design-of-Experiments-Based Approach for Efficient Estimation of Bimodal Gaussian Mixture Weights

Normal mixture models are widely used to represent data arising from latent subpopulations. We propose a Design-of-Experiments (DOE) and Response Surface Methodology (RSM) framework to estimate the weights of a bimodal Gaussian mixture when component families are known. The procedure is non-iterative: rather than alternating Expectation Maximization (EM) steps, it performs a double-stage method - fit a quadratic response surface to the sample log-likelihood over the weight simplex and solve one constrained optimization - followed by a final Maximum Likelihood re-estimation of means and variances. This yields predictable runtime (driven by design size) and reduced sensitivity to initialization. The pipeline uses (i) k-medians to obtain preliminary component parameters and 99% confidence intervals (CIs) for component proportions; (ii) builds a simplex-lattice mixture design within those CI bounds; (iii) fits a quadratic response surface to log-likelihood; and (iv) optimizes this surface under sum-to-one constraints. We validate the method in 27 Monte Carlo scenarios (n = 100, 500, 1000; low/medium/high differentiation and three weight settings). In medium/high separation, it attains comparable likelihoods to EM while achieving more favorable BIC in multiple scenarios and indistinguishable AIC in many, whereas EM is preferable under low separation. Two real data sets - Old Faithful (Waiting variable) and Photovoltaic Energy (Production variable) - further confirm applicability, with lower AIC/BIC in Old Faithful and lower BIC in PV; clustering agreement is high (κ ≈ 0.99 - 1.00). Overall, DOE-RSM offers a simple, interpretable, and often more parsimonious method, and constitutes a non-iterative alternative for mixture-weight estimation.

Authors

Institutions

Publication Details

Journal
IEEE Access
Published
2025-01-01
DOI
https://doi.org/10.1109/access.2025.3614023
Primary Topic
Advanced Chemical Sensor Technologies
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A Design-of-Experiments-Based Approach for Efficient Estimation of Bimodal Gaussian Mixture Weights

Lupércio França Bessegato, Pedro Paulo Balestrassi, Farid Melgani, Yasmin Silva Martins et al.
IEEE Access
Advanced Chemical Sensor Technologies
article

A Design-of-Experiments-Based Approach for Efficient Estimation of Bimodal Gaussian Mixture Weights

Lupércio França Bessegato, Pedro Paulo Balestrassi, Farid Melgani, Yasmin Silva Martins, Gustavo Leal
article en

Abstract

Normal mixture models are widely used to represent data arising from latent subpopulations. We propose a Design-of-Experiments (DOE) and Response Surface Methodology (RSM) framework to estimate the weights of a bimodal Gaussian mixture when component families are known. The procedure is non-iterative: rather than alternating Expectation Maximization (EM) steps, it performs a double-stage method - fit a quadratic response surface to the sample log-likelihood over the weight simplex and solve one constrained optimization - followed by a final Maximum Likelihood re-estimation of means and variances. This yields predictable runtime (driven by design size) and reduced sensitivity to initialization. The pipeline uses (i) k-medians to obtain preliminary component parameters and 99% confidence intervals (CIs) for component proportions; (ii) builds a simplex-lattice mixture design within those CI bounds; (iii) fits a quadratic response surface to log-likelihood; and (iv) optimizes this surface under sum-to-one constraints. We validate the method in 27 Monte Carlo scenarios (n = 100, 500, 1000; low/medium/high differentiation and three weight settings). In medium/high separation, it attains comparable likelihoods to EM while achieving more favorable BIC in multiple scenarios and indistinguishable AIC in many, whereas EM is preferable under low separation. Two real data sets - Old Faithful (Waiting variable) and Photovoltaic Energy (Production variable) - further confirm applicability, with lower AIC/BIC in Old Faithful and lower BIC in PV; clustering agreement is high (κ ≈ 0.99 - 1.00). Overall, DOE-RSM offers a simple, interpretable, and often more parsimonious method, and constitutes a non-iterative alternative for mixture-weight estimation.

IEEE AccessVol. 13
Universidade Federal de Juiz de Fora (BR), University of Trento (IT), Tashkent State University of Economics (UZ), Universidade Federal de Itajubá (BR)
Openalex Percentile: Top 75%
Advanced Chemical Sensor Technologies
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.