Alignment Drift in CEFR-prompted LLMs for Interactive Spanish Tutoring

This paper investigates the potentials of Large Language Models (LLMs) as adaptive tutors in the context of second-language learning.In particular, we evaluate whether system prompting can reliably constrain LLMs to generate only text appropriate to the student's competence level.We simulate full teacher-student dialogues in Spanish using instruction-tuned, open-source LLMs ranging in size from 7B to 12B parameters.Dialogues are generated by having an LLM alternate between tutor and student roles with separate chat histories.The output from the tutor model is then used to evaluate the effectiveness of CEFR-based prompting to control text difficulty across three proficiency levels (A1, B1, C1).Our findings suggest that while system prompting can be used to constrain model outputs, prompting alone is too brittle for sustained, long-term interactional contexts -a phenomenon we term alignment drift.Our results provide insights into the feasibility of LLMs for personalized, proficiencyaligned adaptive tutors and provide a scalable method for low-cost evaluation of model performance without human participants.

Authors

Institutions

Publication Details

Published
2025-01-01
DOI
https://doi.org/10.18653/v1/2025.bea-1.6
Primary Topic
Natural Language Processing Techniques
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Alignment Drift in CEFR-prompted LLMs for Interactive Spanish Tutoring

Ross Deans Kristensen‐McLachlan, Mina Almasi
Natural Language Processing Techniques
article

Alignment Drift in CEFR-prompted LLMs for Interactive Spanish Tutoring

Ross Deans Kristensen‐McLachlan, Mina Almasi
article en

Abstract

This paper investigates the potentials of Large Language Models (LLMs) as adaptive tutors in the context of second-language learning.In particular, we evaluate whether system prompting can reliably constrain LLMs to generate only text appropriate to the student's competence level.We simulate full teacher-student dialogues in Spanish using instruction-tuned, open-source LLMs ranging in size from 7B to 12B parameters.Dialogues are generated by having an LLM alternate between tutor and student roles with separate chat histories.The output from the tutor model is then used to evaluate the effectiveness of CEFR-based prompting to control text difficulty across three proficiency levels (A1, B1, C1).Our findings suggest that while system prompting can be used to constrain model outputs, prompting alone is too brittle for sustained, long-term interactional contexts -a phenomenon we term alignment drift.Our results provide insights into the feasibility of LLMs for personalized, proficiencyaligned adaptive tutors and provide a scalable method for low-cost evaluation of model performance without human participants.

State and University Library (DK)
Netherlands eScience Center, Syddansk Universitet
Openalex Percentile: Top 90%
Natural Language Processing Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Alignment Drift in CEFR-prompted LLMs for Interactive Spanish Tutoring — Ross Deans Kristensen‐McLachlan, Mina Almasi · (2025) | TGRS Research Map | TGRS