Meta-predictive ensembles of LLM pipelines for automated named entity recognition in aerospace software requirements

Abstract In safety-critical aerospace systems, errors in requirements engineering can lead to significant operational risks, which makes accurate information extraction essential. Named Entity Recognition (NER) plays a crucial role in this process by supporting tasks such as requirements classification and automated test case generation. Despite the emergence of diverse language model–based predictive pipelines across multiple domains for NER, the aerospace software development field has so far witnessed only limited exploration of the capabilities of foundational large language models (LLMs). This study investigates the effectiveness of foundational LLMs, recurrent architecture–enhanced LLMs, and generative models under domain-specific constraints. However, single-model approaches struggle with stability, domain shifts, and difficulty in capturing long-context dependencies, which motivates the need for more robust solutions. To address this, the study proposes a novel meta-predictive pipeline that integrates heterogeneous models for improved robustness. To develop a robust and precise meta predictor, it benchmarks the performance of 15 foundational LLMs, 30 recurrently enhanced LLMs, and 4 generative language models, including DeepSeek, ChatGPT, LLaMA, and Gemini. Finally, 12 distinct meta-predictors were developed based on foundational LLMs and recurrent architectures. The best performing meta predictor on the public AeroBERT-NER benchmark dataset achieved 94.73%, 93.59%, and 94.17% precision, recall, and F1-score, respectively. The key findings demonstrate the potential of the proposed approach to improve reliability and scalability in aerospace requirements engineering workflows.

Authors

Institutions

Publication Details

Journal
Automated Software Engineering
Published
2026-11-12
DOI
https://doi.org/10.1007/s10515-026-00694-x
Primary Topic
Topic Modeling
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Meta-predictive ensembles of LLM pipelines for automated named entity recognition in aerospace software requirements

Muhammad Nabeel Asim, Summra Saleem, Andreas R. Dengel
Automated Software Engineering
Topic Modeling
article

Meta-predictive ensembles of LLM pipelines for automated named entity recognition in aerospace software requirements

Muhammad Nabeel Asim, Summra Saleem, Andreas R. Dengel
article en

Abstract

Abstract In safety-critical aerospace systems, errors in requirements engineering can lead to significant operational risks, which makes accurate information extraction essential. Named Entity Recognition (NER) plays a crucial role in this process by supporting tasks such as requirements classification and automated test case generation. Despite the emergence of diverse language model–based predictive pipelines across multiple domains for NER, the aerospace software development field has so far witnessed only limited exploration of the capabilities of foundational large language models (LLMs). This study investigates the effectiveness of foundational LLMs, recurrent architecture–enhanced LLMs, and generative models under domain-specific constraints. However, single-model approaches struggle with stability, domain shifts, and difficulty in capturing long-context dependencies, which motivates the need for more robust solutions. To address this, the study proposes a novel meta-predictive pipeline that integrates heterogeneous models for improved robustness. To develop a robust and precise meta predictor, it benchmarks the performance of 15 foundational LLMs, 30 recurrently enhanced LLMs, and 4 generative language models, including DeepSeek, ChatGPT, LLaMA, and Gemini. Finally, 12 distinct meta-predictors were developed based on foundational LLMs and recurrent architectures. The best performing meta predictor on the public AeroBERT-NER benchmark dataset achieved 94.73%, 93.59%, and 94.17% precision, recall, and F1-score, respectively. The key findings demonstrate the potential of the proposed approach to improve reliability and scalability in aerospace requirements engineering workflows.

Automated Software EngineeringVol. 34(1)
German Research Centre for Artificial Intelligence (DE), Rheinland-Pfälzische Technische Universität Kaiserslautern-Landau (DE)
Rheinland-Pfälzische Technische Universität Kaiserslautern-Landau
Topic Modeling
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon