A study on design and multimodal evaluation of intuitive interfaces for complex information systems in manned/unmanned cooperation

Aiming to address the problems of high cognitive load and low information perception efficiency of complex information system interfaces in manned/unmanned cooperative operations, this study proposes an interface optimization method based on the intuitive interaction paradigm. By constructing a three-dimensional information architecture containing state parameters of multiple target types, UAV behavioural intent parameters, and target situational parameters, we designed an intergroup control experiment between traditional and intuitive interfaces.The experiment adopted a simulated battlefield mission paradigm, and synchronously recorded operators' behavioural performances (response time, correctness rate), oculomotor characteristics (fixations hotspots, scanning paths), and electroencephalographic signals (P300 amplitude and latency) and combined with a multimodal data fusion analysis method to verify the interface optimisation effect. The results showed that the intuitive interface performed better in terms of situational awareness, operational efficiency and task effectiveness, and the NASA-TLX cognitive load scores were lower than those of the traditional interface, with a significant difference between groups (p = 0.003).This study explored potential methods for the design of interfaces for complex information systems based on our experimental findings: (1) Suggesting that encoding multi-target state parameters with dynamic highlighting may improve multi-target tracking accuracy, particularly when a single-information carrier embeds ≤ 3 intuitive elements; (2) UAV intent parameters need to be designed differently based on semantic features, and flicker cues combined with colour stereotype encoding are adopted for preconditioned parameters, which can shorten the time of intent recognition; (3) Target situation parameters need to establish a local-global dynamic mapping mechanism, and iconized presentation can reduce the fixations dwell time compared to textual description.The findings from this study may offer preliminary insights and a potential theoretical foundation for future interface design of human-machine cooperative systems in dynamic high-stakes environments.

Authors

Institutions

Publication Details

Journal
Scientific Reports
Published
2026-01-05
DOI
https://doi.org/10.1038/s41598-026-35017-3
Primary Topic
Human-Automation Interaction and Safety
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A study on design and multimodal evaluation of intuitive interfaces for complex information systems in manned/unmanned cooperation

Jue Qu, Haoyang Jiao, Sina Dang, Wei Wang et al.
Scientific Reports
Human-Automation Interaction and Safety
article

A study on design and multimodal evaluation of intuitive interfaces for complex information systems in manned/unmanned cooperation

Jue Qu, Haoyang Jiao, Sina Dang, Wei Wang, Shuai CHEN
article en

Abstract

Aiming to address the problems of high cognitive load and low information perception efficiency of complex information system interfaces in manned/unmanned cooperative operations, this study proposes an interface optimization method based on the intuitive interaction paradigm. By constructing a three-dimensional information architecture containing state parameters of multiple target types, UAV behavioural intent parameters, and target situational parameters, we designed an intergroup control experiment between traditional and intuitive interfaces.The experiment adopted a simulated battlefield mission paradigm, and synchronously recorded operators' behavioural performances (response time, correctness rate), oculomotor characteristics (fixations hotspots, scanning paths), and electroencephalographic signals (P300 amplitude and latency) and combined with a multimodal data fusion analysis method to verify the interface optimisation effect. The results showed that the intuitive interface performed better in terms of situational awareness, operational efficiency and task effectiveness, and the NASA-TLX cognitive load scores were lower than those of the traditional interface, with a significant difference between groups (p = 0.003).This study explored potential methods for the design of interfaces for complex information systems based on our experimental findings: (1) Suggesting that encoding multi-target state parameters with dynamic highlighting may improve multi-target tracking accuracy, particularly when a single-information carrier embeds ≤ 3 intuitive elements; (2) UAV intent parameters need to be designed differently based on semantic features, and flicker cues combined with colour stereotype encoding are adopted for preconditioned parameters, which can shorten the time of intent recognition; (3) Target situation parameters need to establish a local-global dynamic mapping mechanism, and iconized presentation can reduce the fixations dwell time compared to textual description.The findings from this study may offer preliminary insights and a potential theoretical foundation for future interface design of human-machine cooperative systems in dynamic high-stakes environments.

Scientific ReportsVol. 16(1)
Air Force Engineering University (CN)
National Natural Science Foundation of China, National Outstanding Youth Science Fund Project of National Natural Science Foundation of China
Partnerships for the goals
Openalex Percentile: Top 97%
Human-Automation Interaction and Safety
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.