The impact of professional training on the adoption of LLMs in architectural structural design: a longitudinal study based on UTAUT

Purpose This study investigates how structured training impacts LLM adoption in architectural structural design. Despite LLMs’ potential, adoption barriers persist due to unclear implementation guidelines and insufficient training. Using UTAUT, this research examines how training influences performance expectancy, effort expectancy, social influence and facilitating conditions, while considering individual factors like gender and experience. Design/methodology/approach This study employs a longitudinal research design to examine how professional training influences the adoption of Large Language Models (LLMs) in architectural structural design. A total of 144 professionals participated in structured training, with pre- and post-training assessments measuring changes in technology acceptance using the unified theory of acceptance and use of technology (UTAUT) framework. Structural equation modeling (SEM) analyzed UTAUT constructs and behavioral intention, while multi-group analysis explored variations by gender and experience. Findings Results show significant improvements in technology acceptance post-training, especially in performance expectancy (ß: 0.509 → 0.810, p < 0.001). Training reduced gender disparities, with female professionals exhibiting greater confidence and behavioral intention. Junior professionals showed the highest gains. While training improved ease of use and social influence, its impact on facilitating conditions was minimal. Social implications This study demonstrates how structured training can reduce gender disparities in technology adoption within male-dominated professional fields. The finding that comprehensive LLM training significantly enhanced confidence and behavioral intention among female professionals provides actionable guidance for organizations seeking to promote diversity and inclusion in AI adoption. By accommodating diverse learning preferences and addressing experience-based differences, professional training programs can democratize access to emerging technologies and create more equitable opportunities for career advancement in technical disciplines. Originality/value This study extends UTAUT by showing how professional training dynamically influences technology adoption. Unlike prior research, it empirically demonstrates how structured training mitigates gender disparities and enhances confidence in AI use. The longitudinal design provides insights into evolving acceptance factors, offering guidance for organizations integrating LLMs in architecture and engineering.

Authors

Institutions

Publication Details

Journal
Engineering Construction & Architectural Management
Published
2025-12-09
DOI
https://doi.org/10.1108/ecam-02-2025-0318
Primary Topic
Design Education and Practice
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

The impact of professional training on the adoption of LLMs in architectural structural design: a longitudinal study based on UTAUT

Seungho Cho, Seunguk Na, Young-Sook Roh
Engineering Construction & Architectural Management
Design Education and Practice
article

The impact of professional training on the adoption of LLMs in architectural structural design: a longitudinal study based on UTAUT

Seungho Cho, Seunguk Na, Young-Sook Roh
article en

Abstract

Purpose This study investigates how structured training impacts LLM adoption in architectural structural design. Despite LLMs’ potential, adoption barriers persist due to unclear implementation guidelines and insufficient training. Using UTAUT, this research examines how training influences performance expectancy, effort expectancy, social influence and facilitating conditions, while considering individual factors like gender and experience. Design/methodology/approach This study employs a longitudinal research design to examine how professional training influences the adoption of Large Language Models (LLMs) in architectural structural design. A total of 144 professionals participated in structured training, with pre- and post-training assessments measuring changes in technology acceptance using the unified theory of acceptance and use of technology (UTAUT) framework. Structural equation modeling (SEM) analyzed UTAUT constructs and behavioral intention, while multi-group analysis explored variations by gender and experience. Findings Results show significant improvements in technology acceptance post-training, especially in performance expectancy (ß: 0.509 → 0.810, p < 0.001). Training reduced gender disparities, with female professionals exhibiting greater confidence and behavioral intention. Junior professionals showed the highest gains. While training improved ease of use and social influence, its impact on facilitating conditions was minimal. Social implications This study demonstrates how structured training can reduce gender disparities in technology adoption within male-dominated professional fields. The finding that comprehensive LLM training significantly enhanced confidence and behavioral intention among female professionals provides actionable guidance for organizations seeking to promote diversity and inclusion in AI adoption. By accommodating diverse learning preferences and addressing experience-based differences, professional training programs can democratize access to emerging technologies and create more equitable opportunities for career advancement in technical disciplines. Originality/value This study extends UTAUT by showing how professional training dynamically influences technology adoption. Unlike prior research, it empirically demonstrates how structured training mitigates gender disparities and enhances confidence in AI use. The longitudinal design provides insights into evolving acceptance factors, offering guidance for organizations integrating LLMs in architecture and engineering.

Engineering Construction & Architectural Management
Seoul National University of Science and Technology (KR), Dankook University (KR)
Openalex Percentile: Top 59%
Design Education and Practice
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.