Designing a Serious Game Prototype for Integrated Dialogue Agent Development and First-Aid Research

Responding to a medical emergency requires a bystander to simultaneously call emergency services, communicate observable signs, and perform first-aid actions under the call-taker's guidance. Existing training approaches rehearse these skills separately, and acquired CPR skills decay within months of instruction. We present a serious-game prototype that combines emergency-call practice with first-aid actions in a single interactive scenario. A task-oriented dialogue agent, combining an extended finite-state machine with a large language model (EFSM+LLM), simulates a professional call-taker following established emergency-call protocols. In an office scenario, the player discovers a collapsed colleague and is guided through cardiac arrest detection and CPR. Speech recognition and speech synthesis run locally on the player's device; only transcribed dialogue reaches the dialogue agent, thereby preserving the information asymmetry of real audio-only emergency calls. The resulting system requires the player to coordinate speaking, listening, and acting concurrently, making effective communication part of the task. Its modular architecture separates the dialogue agent, front-end, and dialogue policy. This supports controlled comparisons of interface modality, dialogue policy, and speech processing and provides a reusable platform for research into emergency-call communication and first-aid performance.

Authors

Institutions

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-10-29
DOI
https://doi.org/10.5281/zenodo.23775150
Primary Topic
Speech and dialogue systems
Type
preprint

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
preprint

Designing a Serious Game Prototype for Integrated Dialogue Agent Development and First-Aid Research

Jane Jean Kiam, Sean Patrick Klein
1 links
Zenodo (CERN European Organization for Nuclear Research)
Speech and dialogue systems
preprint

Designing a Serious Game Prototype for Integrated Dialogue Agent Development and First-Aid Research

Jane Jean Kiam, Sean Patrick Klein
preprint en

Abstract

Responding to a medical emergency requires a bystander to simultaneously call emergency services, communicate observable signs, and perform first-aid actions under the call-taker's guidance. Existing training approaches rehearse these skills separately, and acquired CPR skills decay within months of instruction. We present a serious-game prototype that combines emergency-call practice with first-aid actions in a single interactive scenario. A task-oriented dialogue agent, combining an extended finite-state machine with a large language model (EFSM+LLM), simulates a professional call-taker following established emergency-call protocols. In an office scenario, the player discovers a collapsed colleague and is guided through cardiac arrest detection and CPR. Speech recognition and speech synthesis run locally on the player's device; only transcribed dialogue reaches the dialogue agent, thereby preserving the information asymmetry of real audio-only emergency calls. The resulting system requires the player to coordinate speaking, listening, and acting concurrently, making effective communication part of the task. Its modular architecture separates the dialogue agent, front-end, and dialogue policy. This supports controlled comparisons of interface modality, dialogue policy, and speech processing and provides a reusable platform for research into emergency-call communication and first-aid performance.

Zenodo (CERN European Organization for Nuclear Research)
Universität der Bundeswehr München (DE)
European Commission
Good health and well-being
Speech and dialogue systems
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon