Levels of Automation for a Computer-Based Procedure for Simulated Nuclear Power Plant Operation: Impacts on Workload and Trust

Nuclear power plants increasingly utilize digitalized systems, including computer-based procedures (CBPs) and automation. These novel technologies require human factors’ evaluation to ensure safety. Potentially, automation contributes to safety by reducing workload, but automation may also induce a loss of situation awareness and trust miscalibration. The current study investigated workload during a simulated nuclear power plant (NPP) emergency operation procedure (EOP) executed using a CBP supported by automation. Two levels of automation (LOA) were compared within subjects: management-by-consent (lower LOA) and management-by-exception (higher LOA). Subjective workload and trust were assessed, together with objective psychophysiological and performance-based workload measures. LOA effects varied across the different workload measures. The hypothesis that workload would be reduced at the higher LOA was confirmed for a behavioral measure (secondary task response time). However, other metrics, including instantaneous self-assessment (ISA) and heart rate variability (HRV), showed increased workload at the higher LOA. Different LOAs may produce differing operator strategies that require multivariate workload assessment to evaluate. Effect sizes for the impact of LOA on workload were indexed by Cohen’s d. Several of these effect sizes were in the 0.4–0.6 range, indicating effects of medium magnitude. In addition, subjective workload data were compared with those from a previous study that simulated conventional NPP operations. As anticipated, workload tended to be lower with the automated procedure. The study suggests future directions for human factors research on plant modernization.

Authors

Institutions

Publication Details

Journal
Safety
Published
2025-03-02
DOI
https://doi.org/10.3390/safety11010022
Citations
2
Primary Topic
Risk and Safety Analysis
Type
article
Field-Weighted Citation Impact
2.80

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Levels of Automation for a Computer-Based Procedure for Simulated Nuclear Power Plant Operation: Impacts on Workload and Trust

Gerald Matthews, Jacquelyn Schreck, Sean Mondesire, John Grasso et al.
2 citations
Safety
Risk and Safety Analysis
2.80
article

Levels of Automation for a Computer-Based Procedure for Simulated Nuclear Power Plant Operation: Impacts on Workload and Trust

Gerald Matthews, Jacquelyn Schreck, Sean Mondesire, John Grasso, Kelly Dickerson, Jinchao Lin, David Metcalf
article en
2 citations

Abstract

Nuclear power plants increasingly utilize digitalized systems, including computer-based procedures (CBPs) and automation. These novel technologies require human factors’ evaluation to ensure safety. Potentially, automation contributes to safety by reducing workload, but automation may also induce a loss of situation awareness and trust miscalibration. The current study investigated workload during a simulated nuclear power plant (NPP) emergency operation procedure (EOP) executed using a CBP supported by automation. Two levels of automation (LOA) were compared within subjects: management-by-consent (lower LOA) and management-by-exception (higher LOA). Subjective workload and trust were assessed, together with objective psychophysiological and performance-based workload measures. LOA effects varied across the different workload measures. The hypothesis that workload would be reduced at the higher LOA was confirmed for a behavioral measure (secondary task response time). However, other metrics, including instantaneous self-assessment (ISA) and heart rate variability (HRV), showed increased workload at the higher LOA. Different LOAs may produce differing operator strategies that require multivariate workload assessment to evaluate. Effect sizes for the impact of LOA on workload were indexed by Cohen’s d. Several of these effect sizes were in the 0.4–0.6 range, indicating effects of medium magnitude. In addition, subjective workload data were compared with those from a previous study that simulated conventional NPP operations. As anticipated, workload tended to be lower with the automated procedure. The study suggests future directions for human factors research on plant modernization.

SafetyVol. 11(1)
University of Central Florida (US), United States Nuclear Regulatory Commission (US), George Mason University (US), Université Bourgogne Franche-Comté (FR)
U.S. Nuclear Regulatory Commission
Openalex Percentile: Top 10%
Risk and Safety Analysis
2.80
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.