A modular tool-driven RAG framework for engineering test documentation

Engineering test procedures encapsulate decades of domain knowledge and experiential decision-making accumulated by human experts. However, reusing this knowledge across projects remains labour-intensive, as engineers must repeatedly interpret historical documents and customer-specific requirements. This study proposes a design-oriented, tool-driven framework for procedural knowledge reuse, integrating retrieval-augmented generation (RAG) with structured parameter handling and template-guided generation. The system adopts a single-agent architecture that coordinates evidence retrieval, constraint alignment, and controlled content generation, enabling the explicit use of specification conditions in procedure drafting. By grounding generation in retrieved evidence, the framework supports consistency, traceability, and alignment with engineering standards while reducing reliance on model-internal knowledge. A case study in transformer testing shows that the proposed approach achieves a condition-detection accuracy of 0.969, a BERTScore F1 of 0.92, and reduces average drafting time from 52 to 15 min. These results suggest its potential applicability to documentation tasks with similar procedural characteristics.

Authors

Institutions

Publication Details

Journal
Journal of Engineering Design
Published
2026-08-13
DOI
https://doi.org/10.1080/09544828.2026.2698389
Primary Topic
Engineering and Test Systems
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A modular tool-driven RAG framework for engineering test documentation

Chun-Hua Chien, Amy J.C. Trappey, Wen-Yan Huang
Journal of Engineering Design
Engineering and Test Systems
article

A modular tool-driven RAG framework for engineering test documentation

Chun-Hua Chien, Amy J.C. Trappey, Wen-Yan Huang
article en

Abstract

Engineering test procedures encapsulate decades of domain knowledge and experiential decision-making accumulated by human experts. However, reusing this knowledge across projects remains labour-intensive, as engineers must repeatedly interpret historical documents and customer-specific requirements. This study proposes a design-oriented, tool-driven framework for procedural knowledge reuse, integrating retrieval-augmented generation (RAG) with structured parameter handling and template-guided generation. The system adopts a single-agent architecture that coordinates evidence retrieval, constraint alignment, and controlled content generation, enabling the explicit use of specification conditions in procedure drafting. By grounding generation in retrieved evidence, the framework supports consistency, traceability, and alignment with engineering standards while reducing reliance on model-internal knowledge. A case study in transformer testing shows that the proposed approach achieves a condition-detection accuracy of 0.969, a BERTScore F1 of 0.92, and reduces average drafting time from 52 to 15 min. These results suggest its potential applicability to documentation tasks with similar procedural characteristics.

Journal of Engineering Design
National Tsing Hua University (TW), Yuan Ze University (TW)
Openalex Percentile: Top 13%
Engineering and Test Systems
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.