Usability of large language models for building construction safety risk assessment

Purpose Risk assessment is an approach that involves identifying potential workplace risks and determining the necessary precautions to reduce their impact on workers. The advent of artificial intelligence (AI) technology in recent years has greatly benefited safety experts in their assessments of risks. Large language models (LLMs), such as ChatGPT, may provide significant advantages in occupational safety professionals’ risk assessment processes. LLMs enable them to quickly access information, generate reports, analyze data and provide recommendations thanks to their natural language processing capability. This study aims to evaluate the usability of LLMs as a decision-support tool for risk assessments in building construction. Design/methodology/approach First, risks and precautions were defined for 12 work items in building construction. Subsequently, ten experts and ChatGPT were requested to evaluate the risks based on their level of importance using a five-point Likert scale. The similarity of the responses was calculated using the Modified Manhattan Distance. Next, the precautionary choices made by the experts and ChatGPT were compared. Findings It was found that the LLM provided similar answers to the experts in terms of risk scores and precaution selection. Nevertheless, the similarity value of ChatGPT responses surpasses the similarity value of expert responses. Originality/value This study enhances the existing body of knowledge and provides valuable insights to industry stakeholders by showcasing the effectiveness of LLMs in evaluating occupational health and safety hazards. Moreover, to the best of our knowledge, this study represents one of the initial attempts to evaluate occupational safety and health risks with ChatGPT.

Authors

Publication Details

Journal
Engineering Construction & Architectural Management
Published
2025-06-21
DOI
https://doi.org/10.1108/ecam-08-2024-1143
Citations
4
Primary Topic
Occupational Health and Safety Research
Type
article
Field-Weighted Citation Impact
6.16
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Usability of large language models for building construction safety risk assessment

Mustafa Oral, Serkan Aydınlı, Ercan Erdiş, Özge Alboga
4 citations
Engineering Construction & Architectural Management
Occupational Health and Safety Research
6.16
article

Usability of large language models for building construction safety risk assessment

Mustafa Oral, Serkan Aydınlı, Ercan Erdiş, Özge Alboga
article en
4 citations

Abstract

Purpose Risk assessment is an approach that involves identifying potential workplace risks and determining the necessary precautions to reduce their impact on workers. The advent of artificial intelligence (AI) technology in recent years has greatly benefited safety experts in their assessments of risks. Large language models (LLMs), such as ChatGPT, may provide significant advantages in occupational safety professionals’ risk assessment processes. LLMs enable them to quickly access information, generate reports, analyze data and provide recommendations thanks to their natural language processing capability. This study aims to evaluate the usability of LLMs as a decision-support tool for risk assessments in building construction. Design/methodology/approach First, risks and precautions were defined for 12 work items in building construction. Subsequently, ten experts and ChatGPT were requested to evaluate the risks based on their level of importance using a five-point Likert scale. The similarity of the responses was calculated using the Modified Manhattan Distance. Next, the precautionary choices made by the experts and ChatGPT were compared. Findings It was found that the LLM provided similar answers to the experts in terms of risk scores and precaution selection. Nevertheless, the similarity value of ChatGPT responses surpasses the similarity value of expert responses. Originality/value This study enhances the existing body of knowledge and provides valuable insights to industry stakeholders by showcasing the effectiveness of LLMs in evaluating occupational health and safety hazards. Moreover, to the best of our knowledge, this study represents one of the initial attempts to evaluate occupational safety and health risks with ChatGPT.

Engineering Construction & Architectural Management
Openalex Percentile: Top 4%
Occupational Health and Safety Research
6.16
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Usability of large language models for building construction safety risk assessment — Mustafa Oral, Serkan Aydınlı, et al. · Engineering Construction & Architectural Management (2025) | TGRS Research Map | TGRS