A Framework to Establish a Blind Validation Challenge for ECLSS Modeling and Simulation

Environmental Control and Life Support Systems (ECLSS) are complex systems of systems designed to meet the metabolic needs of the crew. Several ECLSS modeling and simulation tools have been developed, however they have limited utility as the models have not been fully validated, in part due to the lack of publicly available experimental data to do so. Thus, this paper poses a challenge with principal goal to promote and improve model development for the prediction of ECLSS performance, whether of flight-proven technologies or those at low technology readiness levels. To achieve this goal, models will be verified – Was the model coded correctly? and validated for accuracy of results – Does the model correctly simulate the ECLSS? We will identify and describe suitable test cases for model simulations by challenge participants, however ‘truth’ performance data (to the extent known) will be withheld until simulation results have been submitted. The purpose being to make this a blind challenge. Metrics for assessment include the lines of code, computational cost, the level of empiricism in model development, the accuracy of system- and subsystem-level results, and the estimated uncertainty on results. Through this challenge, we expect to identify shortcomings in experimental data for validation. Model verification and validation will instill confidence in application of the ECLSS modeling and simulation capabilities for space habitat design and analysis.