Adaptive Ensemble-Based Hyperparameter-Free Just-In-Time Learning for Robust Cell Culture Process Monitoring

The production process in the biopharmaceutical industry relies on various Process Analytical Technologies (PAT) to ensure safety and consistency. Raman spectroscopy is a commonly used PAT, enabling real-time monitoring and control of cell culture processes by correlating Raman signals with key variables through data-driven models. To enhance the performance of these Raman models, just-in-time learning (JITL) can be employed to learn from a relevant subset of historical data, allowing JITL to adapt quickly to data generated from dynamic environments, such as bioreactors. This ensures the models remain accurate and effective in real-time applications. A critical and highly sensitive parameter in JITL is the number of data points used to train the model, commonly denoted as k . However, most studies determine k based on past experiences or trial and error and apply the same k value for all experiments, which is not ideal for data with constant changes, such as bioprocess data, leading to suboptimal outcomes. This study addresses this gap by developing a two-layer ensemble-based JITL method that combines predictions from models with different k values and automatically adjusts the weights of individual predictors to adapt to changes in the data, eliminating the need for manual adjustments from the user. Thirty-eight experimental bioreactor runs using different cell lines and feed media were conducted to evaluate the algorithm’s performance. The findings demonstrate that the ensemble approach consistently achieved superior performance, eliminating the need to manually select and tune the highly sensitive hyperparameter k , creating a hyperparameter-free Just-In-Time Learning approach for users. This approach is particularly appealing in scenarios where hyperparameter tuning is not feasible due to limited available data and frequently changing environments requiring constant tuning of hyperparameters.

Authors

Institutions

Publication Details

Journal
Procedia Computer Science
Published
2025-01-01
DOI
https://doi.org/10.1016/j.procs.2025.07.127
Citations
2
Primary Topic
Fault Detection and Control Systems
Type
article
Field-Weighted Citation Impact
2.43

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Adaptive Ensemble-Based Hyperparameter-Free Just-In-Time Learning for Robust Cell Culture Process Monitoring

Robert Bassett, Ellen Otte, Thanh Tung Khuat, Katarzyna Musiał et al.
2 citations
Procedia Computer Science
Fault Detection and Control Systems
2.43
article

Adaptive Ensemble-Based Hyperparameter-Free Just-In-Time Learning for Robust Cell Culture Process Monitoring

Robert Bassett, Ellen Otte, Thanh Tung Khuat, Katarzyna Musiał, Jian Peng, Alistair Grevis-James, Bogdan Gabryś
article en
2 citations

Abstract

The production process in the biopharmaceutical industry relies on various Process Analytical Technologies (PAT) to ensure safety and consistency. Raman spectroscopy is a commonly used PAT, enabling real-time monitoring and control of cell culture processes by correlating Raman signals with key variables through data-driven models. To enhance the performance of these Raman models, just-in-time learning (JITL) can be employed to learn from a relevant subset of historical data, allowing JITL to adapt quickly to data generated from dynamic environments, such as bioreactors. This ensures the models remain accurate and effective in real-time applications. A critical and highly sensitive parameter in JITL is the number of data points used to train the model, commonly denoted as k . However, most studies determine k based on past experiences or trial and error and apply the same k value for all experiments, which is not ideal for data with constant changes, such as bioprocess data, leading to suboptimal outcomes. This study addresses this gap by developing a two-layer ensemble-based JITL method that combines predictions from models with different k values and automatically adjusts the weights of individual predictors to adapt to changes in the data, eliminating the need for manual adjustments from the user. Thirty-eight experimental bioreactor runs using different cell lines and feed media were conducted to evaluate the algorithm’s performance. The findings demonstrate that the ensemble approach consistently achieved superior performance, eliminating the need to manually select and tune the highly sensitive hyperparameter k , creating a hyperparameter-free Just-In-Time Learning approach for users. This approach is particularly appealing in scenarios where hyperparameter tuning is not feasible due to limited available data and frequently changing environments requiring constant tuning of hyperparameters.

Procedia Computer ScienceVol. 264
University of Technology Sydney (AU), CSL (Australia) (AU)
Australian Research Council
Openalex Percentile: Top 10%
Fault Detection and Control Systems
2.43
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.