Evaluating the Impact of LLM-Assisted Natural-Language Commands on Gameplay and Player Experience in The Last Signal

Conventional command interfaces require players to remember predefined wording, which can interrupt play when an intended action is expressed differently. This study examines how an LLM changes command-based gameplay in The Last Signal, a Unity puzzle-adventure game in which players direct a robot named PICO. Twelve participants completed the first two rooms with fixed commands and LLM-assisted natural-language commands. The result screen recorded completion time and command use, while questionnaires measured usability, workload, expressive freedom, perceived control, and overall experience. With LLM assistance, mean completion time decreased from 20.75 to 14.58 minutes, total commands from 27.50 to 20.92, and unrecognized commands from 8.08 to 3.42. Participants also reported greater usability and expressive freedom, a lower workload, and an improved overall experience. Perceived control decreased slightly, but this difference was not statistically significant. Interviews indicated that familiar language and PICO's responses strengthened interaction and cooperation, although unexpected interpretations created uncertainty. The findings show that LLM-assisted commands can improve task efficiency and player experience when players receive clear feedback and can easily correct misunderstood instructions. This within-subject comparison evaluates both command performance and the experience of cooperating with PICO. It provides evidence of the value of flexible commands in a constrained puzzle game.

Authors

Institutions

Publication Details

Journal
Applied and Computational Engineering
Published
2026-11-10
DOI
https://doi.org/10.54254/2755-2721/2026.ld38756
Primary Topic
Usability and User Interface Design
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Evaluating the Impact of LLM-Assisted Natural-Language Commands on Gameplay and Player Experience in The Last Signal

Sitong Wu
Applied and Computational Engineering
Usability and User Interface Design
article

Evaluating the Impact of LLM-Assisted Natural-Language Commands on Gameplay and Player Experience in The Last Signal

Sitong Wu
article en

Abstract

Conventional command interfaces require players to remember predefined wording, which can interrupt play when an intended action is expressed differently. This study examines how an LLM changes command-based gameplay in The Last Signal, a Unity puzzle-adventure game in which players direct a robot named PICO. Twelve participants completed the first two rooms with fixed commands and LLM-assisted natural-language commands. The result screen recorded completion time and command use, while questionnaires measured usability, workload, expressive freedom, perceived control, and overall experience. With LLM assistance, mean completion time decreased from 20.75 to 14.58 minutes, total commands from 27.50 to 20.92, and unrecognized commands from 8.08 to 3.42. Participants also reported greater usability and expressive freedom, a lower workload, and an improved overall experience. Perceived control decreased slightly, but this difference was not statistically significant. Interviews indicated that familiar language and PICO's responses strengthened interaction and cooperation, although unexpected interpretations created uncertainty. The findings show that LLM-assisted commands can improve task efficiency and player experience when players receive clear feedback and can easily correct misunderstood instructions. This within-subject comparison evaluates both command performance and the experience of cooperating with PICO. It provides evidence of the value of flexible commands in a constrained puzzle game.

Applied and Computational EngineeringVol. 279(1)
Fuzhou University (CN)
Usability and User Interface Design
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon