DETERMINING THE IMPACT OF THE HUMAN OPERATOR FACTOR USING A NAVIGATION SIMULATOR

As maritime operations become increasingly complex, there is a growing need for objective, scalable methods to evaluate seafarer competence beyond traditional instructor-based assessments.This study presents a comprehensive, data-driven framework for analyzing cadet performance in maritime simulator exercises, utilizing state-of-the-art unsupervised learning and explainable AI.The research draws on multivariate timeseries data from navigational simulations, capturing vessel dynamics, control actions, and environmental parameters across dozens of features.A rigorous preprocessing pipeline was applied, combining statistical feature aggregation and redundancy reduction through Pearson correlation and Mutual Information.This yielded a compact, yet informative feature set encompassing control inputs, navigational states, and vessel motions.To offset limited number of sessions small in the dataset, each simulation was split into meaningful intervals by applying rolling window statistics.Each window was then encoded as a summary vector, reflecting both central tendencies and temporal variability.The analysis employed the HDBSCAN clustering algorithm, which excels in detecting groups of variable density and naturally identifies outlier behaviorscritical in the context of training evaluation.The resulting clusters were projected into lower-dimensional space via t-SNE, providing interpretable visualizations of cadet performance patterns.To further elicit the distinguishing characteristics of each group, a linear Support Vector Machine was trained to predict cluster membership, with SHapley Additive exPlanations (SHAP) attributing each decision to underlying features.Key findings reveal that clusters align with distinct navigational strategies: stable, conservative approaches are differentiated from more dynamic or risk-prone styles by features such as roll velocity, yaw rate, and engine RPM.Sessions flagged as outliers typically exhibited abrupt maneuvers or inconsistent control usage, highlighting potential skill gaps.The SHAP-based interpretability layer transforms complex model outputs into actionable instructional feedback, enabling targeted interventions and tailored training.Overall, this automated approach has potential to become a transparent, scalable alternative to subjective grading in maritime education, with significant implications for enhancing safety and developing individualized learning pathways.The proposed system demonstrates strong potential for integration into real-world training environments and continuous improvement as more operational data becomes available.

Authors

Publication Details

Journal
Scientific Bulletin Kherson State Maritime Academy
Published
2025-01-01
DOI
https://doi.org/10.33815/2313-4763.2025.1.30.158-170
Primary Topic
Human-Automation Interaction and Safety
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

DETERMINING THE IMPACT OF THE HUMAN OPERATOR FACTOR USING A NAVIGATION SIMULATOR

Павло Носов, P. Kochubei
Scientific Bulletin Kherson State Maritime Academy
Human-Automation Interaction and Safety
article

DETERMINING THE IMPACT OF THE HUMAN OPERATOR FACTOR USING A NAVIGATION SIMULATOR

Павло Носов, P. Kochubei
article en

Abstract

As maritime operations become increasingly complex, there is a growing need for objective, scalable methods to evaluate seafarer competence beyond traditional instructor-based assessments.This study presents a comprehensive, data-driven framework for analyzing cadet performance in maritime simulator exercises, utilizing state-of-the-art unsupervised learning and explainable AI.The research draws on multivariate timeseries data from navigational simulations, capturing vessel dynamics, control actions, and environmental parameters across dozens of features.A rigorous preprocessing pipeline was applied, combining statistical feature aggregation and redundancy reduction through Pearson correlation and Mutual Information.This yielded a compact, yet informative feature set encompassing control inputs, navigational states, and vessel motions.To offset limited number of sessions small in the dataset, each simulation was split into meaningful intervals by applying rolling window statistics.Each window was then encoded as a summary vector, reflecting both central tendencies and temporal variability.The analysis employed the HDBSCAN clustering algorithm, which excels in detecting groups of variable density and naturally identifies outlier behaviorscritical in the context of training evaluation.The resulting clusters were projected into lower-dimensional space via t-SNE, providing interpretable visualizations of cadet performance patterns.To further elicit the distinguishing characteristics of each group, a linear Support Vector Machine was trained to predict cluster membership, with SHapley Additive exPlanations (SHAP) attributing each decision to underlying features.Key findings reveal that clusters align with distinct navigational strategies: stable, conservative approaches are differentiated from more dynamic or risk-prone styles by features such as roll velocity, yaw rate, and engine RPM.Sessions flagged as outliers typically exhibited abrupt maneuvers or inconsistent control usage, highlighting potential skill gaps.The SHAP-based interpretability layer transforms complex model outputs into actionable instructional feedback, enabling targeted interventions and tailored training.Overall, this automated approach has potential to become a transparent, scalable alternative to subjective grading in maritime education, with significant implications for enhancing safety and developing individualized learning pathways.The proposed system demonstrates strong potential for integration into real-world training environments and continuous improvement as more operational data becomes available.

Scientific Bulletin Kherson State Maritime AcademyVol. 1(30)
Openalex Percentile: Top 76%
Human-Automation Interaction and Safety
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.