A Framework for Proficiency-Aligned Grammar Practice in LLM-Based Dialogue Systems

Communicative practice is critical for second language development, yet learners often lack targeted, engaging opportunities to use new grammar structures.While large language models (LLMs) can offer coherent interactions, they are not inherently aligned with pedagogical goals or proficiency levels.In this paper, we explore how LLMs can be integrated into a structured framework for enabling goaloriented, grammar-focused interaction, building on an existing dialogue system.Through controlled simulations, we evaluate five LLMs across 75 A2-level tasks under two conditions: (i) grammar-targeted, task-anchored prompting and (ii) the addition of a lightweight postgeneration validation pipeline using a grammar annotator.Our findings show that templatebased prompting alone substantially increases target-form coverage up to 91.4% for LLaMA 3.1-70B-Instruct, while reducing overly advanced grammar usage.The validation pipeline provides an additional boost in form-focused tasks, raising coverage to 96.3% without significantly degrading appropriateness.

Authors

Publication Details

Published
2025-01-01
DOI
https://doi.org/10.18653/v1/2025.bea-1.74
Citations
1
Primary Topic
Speech and dialogue systems
Type
article
Field-Weighted Citation Impact
2.48

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A Framework for Proficiency-Aligned Grammar Practice in LLM-Based Dialogue Systems

Detmar Meurers, Xiaobin Chen, Luisa Ribeiro-Flucht
1 citations
Speech and dialogue systems
2.48
article

A Framework for Proficiency-Aligned Grammar Practice in LLM-Based Dialogue Systems

Detmar Meurers, Xiaobin Chen, Luisa Ribeiro-Flucht
article en
1 citations

Abstract

Communicative practice is critical for second language development, yet learners often lack targeted, engaging opportunities to use new grammar structures.While large language models (LLMs) can offer coherent interactions, they are not inherently aligned with pedagogical goals or proficiency levels.In this paper, we explore how LLMs can be integrated into a structured framework for enabling goaloriented, grammar-focused interaction, building on an existing dialogue system.Through controlled simulations, we evaluate five LLMs across 75 A2-level tasks under two conditions: (i) grammar-targeted, task-anchored prompting and (ii) the addition of a lightweight postgeneration validation pipeline using a grammar annotator.Our findings show that templatebased prompting alone substantially increases target-form coverage up to 91.4% for LLaMA 3.1-70B-Instruct, while reducing overly advanced grammar usage.The validation pipeline provides an additional boost in form-focused tasks, raising coverage to 96.3% without significantly degrading appropriateness.

Bundesministerium für Bildung und Forschung
Quality Education
Openalex Percentile: Top 9%
Speech and dialogue systems
2.48
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.