Full State-Based CS-QTM: An Architecture for Question Intervention Control in LLM-Based Chatbots

Questions in large language model (LLM)-based chatbots can elicit information, but unnecessary questions create over-intervention, and omissions create under-intervention. We formulate question timing as a control problem and present Full State-Based CS-QTM. The architecture combines Episode Memory, accumulated question state qt, readinesst, question_scoret, adaptive_thresholdt, Prompt Routing, Hard Reset, Cooldown, and Topic Shift handling. A threshold was selected on a conversation-disjoint development set and frozen before evaluation. Evaluation covered 100 Korean dialogue scenarios and 645 turns, with 180 question-mark-aligned Ask and 465 Not Ask operational references. Qwen Frozen Full obtained F1 = 0.3226 versus 0.2332 for the same-generator Local LLM-only; a shallow sequential classifier trained on development data obtained F1 = 0.6139, revealing surface and sequential regularities in labels. Without retuning, EXAONE Frozen Full and LLM-only obtained F1 = 0.3024 and 0.2865. Controlled comparisons showed that threshold policy and generated-context forcing shifted the over-/under-intervention balance; grouped linguistic-feature effects remained uncertain after multiplicity correction. Internal logs separated policy, visible realization, resets, cooldown, topic shifts, and FP/FN paths. These results permit inspection of the closed-loop control process; they do not establish universal model superiority, optimal timing, or benchmark state-of-the-art.

Authors

Institutions

Publication Details

Journal
Applied Sciences
Published
2026-10-15
DOI
https://doi.org/10.3390/app162010217
Primary Topic
Speech and dialogue systems
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Full State-Based CS-QTM: An Architecture for Question Intervention Control in LLM-Based Chatbots

H. S. Kim, 김근형
Applied Sciences
Speech and dialogue systems
article

Full State-Based CS-QTM: An Architecture for Question Intervention Control in LLM-Based Chatbots

H. S. Kim, 김근형
article en

Abstract

Questions in large language model (LLM)-based chatbots can elicit information, but unnecessary questions create over-intervention, and omissions create under-intervention. We formulate question timing as a control problem and present Full State-Based CS-QTM. The architecture combines Episode Memory, accumulated question state qt, readinesst, question_scoret, adaptive_thresholdt, Prompt Routing, Hard Reset, Cooldown, and Topic Shift handling. A threshold was selected on a conversation-disjoint development set and frozen before evaluation. Evaluation covered 100 Korean dialogue scenarios and 645 turns, with 180 question-mark-aligned Ask and 465 Not Ask operational references. Qwen Frozen Full obtained F1 = 0.3226 versus 0.2332 for the same-generator Local LLM-only; a shallow sequential classifier trained on development data obtained F1 = 0.6139, revealing surface and sequential regularities in labels. Without retuning, EXAONE Frozen Full and LLM-only obtained F1 = 0.3024 and 0.2865. Controlled comparisons showed that threshold policy and generated-context forcing shifted the over-/under-intervention balance; grouped linguistic-feature effects remained uncertain after multiplicity correction. Internal logs separated policy, visible realization, resets, cooldown, topic shifts, and FP/FN paths. These results permit inspection of the closed-loop control process; they do not establish universal model superiority, optimal timing, or benchmark state-of-the-art.

Applied SciencesVol. 16(20)
Hoseo University (KR), Konkuk University (KR)
Openalex Percentile: Top 13%
Speech and dialogue systems
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.