Prompt-Strategy-Driven SysML-v2 Artefact Generation Using Large Language Models for Model-Based Systems Engineering

Large Language Models (LLMs) show growing potential for transforming natural-language engineering information into formal model-based artefacts. However, their reliability for SysML-v2 artefact generation remains insufficiently understood, particularly regarding prompt-strategy selection, model-dependent variability, and task-specific performance. This paper proposes a prompt-strategy-driven method for LLM-assisted SysML-v2 artefact generation in Model-Based Systems Engineering. The method is grounded in a systematic literature analysis and a Harvey-Balls-based assessment of existing approaches, which reveal gaps in reproducibility, prompt evaluation, and formal modelling support. The proposed workflow integrates input preparation, prompt-strategy selection, LLM selection, artefact generation, syntax validation, and quality evaluation. It is evaluated using a traction battery system case study across three representative modelling tasks: requirements generation, block definition modelling, and state-machine modelling. Four LLMs are compared using five prompt strategies and assessed through F1-score analysis and LLM-as-a-Judge evaluation. Within the investigated traction-battery case study, the observed artefact scores differed across prompt strategies and modelling tasks, and no single strategy achieved the highest observed score across all tasks. Overall, the findings indicate that LLMs can support early-stage SysML-v2 modelling as human-in-the-loop assistants, while expert validation remains necessary to ensure syntactic correctness, semantic consistency, and domain validity.

Authors

Institutions

Publication Details

Journal
AI
Published
2026-07-23
DOI
https://doi.org/10.3390/ai7080274
Primary Topic
Systems Engineering Methodologies and Applications
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Prompt-Strategy-Driven SysML-v2 Artefact Generation Using Large Language Models for Model-Based Systems Engineering

Thomas Vietor, Umut Volkan Kizgin, Armin Stein, Bjarne Käberich et al.
AI
Systems Engineering Methodologies and Applications
article

Prompt-Strategy-Driven SysML-v2 Artefact Generation Using Large Language Models for Model-Based Systems Engineering

Thomas Vietor, Umut Volkan Kizgin, Armin Stein, Bjarne Käberich, Aaron Dlugosch, Niklas Waldmann, Ajay Kumar Thakur, Souhaiel Ben-Salem
article en

Abstract

Large Language Models (LLMs) show growing potential for transforming natural-language engineering information into formal model-based artefacts. However, their reliability for SysML-v2 artefact generation remains insufficiently understood, particularly regarding prompt-strategy selection, model-dependent variability, and task-specific performance. This paper proposes a prompt-strategy-driven method for LLM-assisted SysML-v2 artefact generation in Model-Based Systems Engineering. The method is grounded in a systematic literature analysis and a Harvey-Balls-based assessment of existing approaches, which reveal gaps in reproducibility, prompt evaluation, and formal modelling support. The proposed workflow integrates input preparation, prompt-strategy selection, LLM selection, artefact generation, syntax validation, and quality evaluation. It is evaluated using a traction battery system case study across three representative modelling tasks: requirements generation, block definition modelling, and state-machine modelling. Four LLMs are compared using five prompt strategies and assessed through F1-score analysis and LLM-as-a-Judge evaluation. Within the investigated traction-battery case study, the observed artefact scores differed across prompt strategies and modelling tasks, and no single strategy achieved the highest observed score across all tasks. Overall, the findings indicate that LLMs can support early-stage SysML-v2 modelling as human-in-the-loop assistants, while expert validation remains necessary to ensure syntactic correctness, semantic consistency, and domain validity.

AIVol. 7(8)
Technische Universität Braunschweig (DE)
Technische Universität Braunschweig
Quality Education
Openalex Percentile: Top 11%
Systems Engineering Methodologies and Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Prompt-Strategy-Driven SysML-v2 Artefact Generation Using Large Language Models for Model-Based Systems Engineering — Thomas Vietor, Umut Volkan Kizgin, et al. · AI (2026) | TGRS Research Map | TGRS