Effects of Evaluation Design on Model Comparison and Selection in Droplet Microfluidics

Machine learning can predict microfluidic droplet size, but the best-performing model for familiar channel geometries may not suit new geometries. Using published flow-focusing droplet data, we compared model recommendations from different evaluation schemes and their predictive outcomes on unseen geometries. With matched training and test record counts in the main dataset, holding out all records of selected geometries increased the gradient-boosted tree model’s mean absolute diameter error from 8.29 to 12.22 µm, a 47.4% increase over random splitting, and reversed its ranking relative to the random forest. We then tested models recommended by the two validation schemes on the same geometries unseen during training. Those selected by geometry-grouped validation had an 8.2% lower mean absolute diameter error, averaged with equal weight per geometry, than those selected by random validation. Fixed random forest had the lowest error. In both candidate sets, operating conditions recommended by models selected through grouped validation had a smaller mean absolute deviation of measured diameter from the target than those recommended using random validation. At ±10% tolerance, the attainment ranking of the two rules depended on the candidate set. Model recommendations for new geometries should therefore be assessed on the same unseen geometries, while target-size recommendations require direct evaluation of the proportion meeting the specified tolerance.

Authors

Institutions

Publication Details

Journal
Micromachines
Published
2026-11-19
DOI
https://doi.org/10.3390/mi17111344
Primary Topic
Innovative Microfluidic and Catalytic Techniques Innovation
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Effects of Evaluation Design on Model Comparison and Selection in Droplet Microfluidics

Qiang Tang, Yuwen Liu, Yunfeng Xing
Micromachines
Innovative Microfluidic and Catalytic Techniques Innovation
article

Effects of Evaluation Design on Model Comparison and Selection in Droplet Microfluidics

Qiang Tang, Yuwen Liu, Yunfeng Xing
article en

Abstract

Machine learning can predict microfluidic droplet size, but the best-performing model for familiar channel geometries may not suit new geometries. Using published flow-focusing droplet data, we compared model recommendations from different evaluation schemes and their predictive outcomes on unseen geometries. With matched training and test record counts in the main dataset, holding out all records of selected geometries increased the gradient-boosted tree model’s mean absolute diameter error from 8.29 to 12.22 µm, a 47.4% increase over random splitting, and reversed its ranking relative to the random forest. We then tested models recommended by the two validation schemes on the same geometries unseen during training. Those selected by geometry-grouped validation had an 8.2% lower mean absolute diameter error, averaged with equal weight per geometry, than those selected by random validation. Fixed random forest had the lowest error. In both candidate sets, operating conditions recommended by models selected through grouped validation had a smaller mean absolute deviation of measured diameter from the target than those recommended using random validation. At ±10% tolerance, the attainment ranking of the two rules depended on the candidate set. Model recommendations for new geometries should therefore be assessed on the same unseen geometries, while target-size recommendations require direct evaluation of the proportion meeting the specified tolerance.

MicromachinesVol. 17(11)
Anhui University of Science and Technology (CN)
Innovative Microfluidic and Catalytic Techniques Innovation
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon