Performance Comparison and Improvement of LLM Models for Automated Generation of Fire Protection System Construction Specifications

This study verifies the effectiveness of using major LLMs (Gemini, Claude, ChatGPT) to automatically generate construction specifications for fire protection systems in specific fire-service-designated objects like factories, warehouses, and hospitals, and conducts a comparative analysis of each model's performance. The evaluation shows that while LLMs generate the basic structure and general content of the specifications well, they have limitations in reflecting the unique characteristics of the target buildings and accurately applying the latest laws. For complex facilities such as hospitals, sophisticated prompt design and expert review were essential. This research confirms the potential of LLMs for document automation in the fire safety field and provides foundational data for the future development of specialized language models for fire protection.

Authors

Publication Details

Journal
Korean Journal of Hazardous Materials
Published
2025-12-31
DOI
https://doi.org/10.31333/kihm.2025.12.3.9
Primary Topic
BIM and Construction Integration
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Performance Comparison and Improvement of LLM Models for Automated Generation of Fire Protection System Construction Specifications

Dongil Shin, Jong-Cheol Kim
Korean Journal of Hazardous Materials
BIM and Construction Integration
article

Performance Comparison and Improvement of LLM Models for Automated Generation of Fire Protection System Construction Specifications

Dongil Shin, Jong-Cheol Kim
article en

Abstract

This study verifies the effectiveness of using major LLMs (Gemini, Claude, ChatGPT) to automatically generate construction specifications for fire protection systems in specific fire-service-designated objects like factories, warehouses, and hospitals, and conducts a comparative analysis of each model's performance. The evaluation shows that while LLMs generate the basic structure and general content of the specifications well, they have limitations in reflecting the unique characteristics of the target buildings and accurately applying the latest laws. For complex facilities such as hospitals, sophisticated prompt design and expert review were essential. This research confirms the potential of LLMs for document automation in the fire safety field and provides foundational data for the future development of specialized language models for fire protection.

Korean Journal of Hazardous MaterialsVol. 13(3)
Sustainable cities and communities
Openalex Percentile: Top 34%
BIM and Construction Integration
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.