An Evaluation Method for Model Maturity Supporting Model-Based Systems Engineering at the Conceptual Design Stage

Multi-level models are core artifacts of Model-Based Systems Engineering (MBSE) for cross-disciplinary collaboration and staged evolution, yet assessing their maturity in the conceptual design phase remains difficult. This paper proposes a systematic, model-centric maturity assessment method for instrumentation conceptual design. By tailoring ISO/IEC 25010 to instrumentation characteristics, we establish a seven-dimensional quality attribute framework (functional suitability, performance efficiency, interaction capability, reliability, maintainability, flexibility, and structural completeness) and an L0–L4 maturity scale for multi-level MBSE models. The indicators are structured using a Quality Attribute Utility Tree. CRITIC derives the objective weights by jointly considering the score dispersion and inter-indicator correlation, and Dempster–Shafer evidence theory is used to map the indicator values and expert ratings onto basic belief assignments and fuses the multi-source evidence to the output maturity levels with explicit confidence and uncertainty. A case study of an automatic dosing instrument for solid foam drainage agents at a high-pressure gas wellhead yields an overall maturity of L1 (Structured), with BetPL1= 0.424, and an overall unknown mass of 0.186. The results highlight reliability and performance efficiency as the main bottlenecks and support targeted model refinement and resource allocation in early-stage design.

Authors

Institutions

Publication Details

Journal
Processes
Published
2026-02-12
DOI
https://doi.org/10.3390/pr14040639
Primary Topic
Systems Engineering Methodologies and Applications
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

An Evaluation Method for Model Maturity Supporting Model-Based Systems Engineering at the Conceptual Design Stage

Tong Li, Wu Zhao, Chong Jiang, Jun Li
Processes
Systems Engineering Methodologies and Applications
article

An Evaluation Method for Model Maturity Supporting Model-Based Systems Engineering at the Conceptual Design Stage

Tong Li, Wu Zhao, Chong Jiang, Jun Li
article en

Abstract

Multi-level models are core artifacts of Model-Based Systems Engineering (MBSE) for cross-disciplinary collaboration and staged evolution, yet assessing their maturity in the conceptual design phase remains difficult. This paper proposes a systematic, model-centric maturity assessment method for instrumentation conceptual design. By tailoring ISO/IEC 25010 to instrumentation characteristics, we establish a seven-dimensional quality attribute framework (functional suitability, performance efficiency, interaction capability, reliability, maintainability, flexibility, and structural completeness) and an L0–L4 maturity scale for multi-level MBSE models. The indicators are structured using a Quality Attribute Utility Tree. CRITIC derives the objective weights by jointly considering the score dispersion and inter-indicator correlation, and Dempster–Shafer evidence theory is used to map the indicator values and expert ratings onto basic belief assignments and fuses the multi-source evidence to the output maturity levels with explicit confidence and uncertainty. A case study of an automatic dosing instrument for solid foam drainage agents at a high-pressure gas wellhead yields an overall maturity of L1 (Structured), with BetPL1= 0.424, and an overall unknown mass of 0.186. The results highlight reliability and performance efficiency as the main bottlenecks and support targeted model refinement and resource allocation in early-stage design.

ProcessesVol. 14(4)
Sichuan University (CN)
Openalex Percentile: Top 59%
Systems Engineering Methodologies and Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.