Intent Matters: Enhancing AI Tutoring with Fine-Grained Pedagogical Intent Annotation

Large language models (LLMs) hold great promise for educational applications, particularly in intelligent tutoring systems.However, effective tutoring requires alignment with pedagogical strategies -something current LLMs lack without task-specific adaptation.In this work, we explore whether finegrained annotation of teacher intents can improve the quality of LLM-generated tutoring responses.We focus on MathDial, a dialog dataset for math instruction, and apply an automated annotation framework to re-annotate a portion of the dataset using a detailed taxonomy of eleven pedagogical intents.We then fine-tune an LLM using these new annotations and compare its performance to models trained on the original four-category taxonomy.Both automatic and qualitative evaluations show that the fine-grained model produces more pedagogically aligned and effective responses.Our findings highlight the value of intent specificity for controlled text generation in educational settings, and we release our annotated data and code to facilitate further research:

Authors

Institutions

Publication Details

Published
2025-01-01
DOI
https://doi.org/10.18653/v1/2025.bea-1.63
Primary Topic
Intelligent Tutoring Systems and Adaptive Learning
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Intent Matters: Enhancing AI Tutoring with Fine-Grained Pedagogical Intent Annotation

Ekaterina Kochmar, Kseniia Petukhova
Intelligent Tutoring Systems and Adaptive Learning
article

Intent Matters: Enhancing AI Tutoring with Fine-Grained Pedagogical Intent Annotation

Ekaterina Kochmar, Kseniia Petukhova
article en

Abstract

Large language models (LLMs) hold great promise for educational applications, particularly in intelligent tutoring systems.However, effective tutoring requires alignment with pedagogical strategies -something current LLMs lack without task-specific adaptation.In this work, we explore whether finegrained annotation of teacher intents can improve the quality of LLM-generated tutoring responses.We focus on MathDial, a dialog dataset for math instruction, and apply an automated annotation framework to re-annotate a portion of the dataset using a detailed taxonomy of eleven pedagogical intents.We then fine-tune an LLM using these new annotations and compare its performance to models trained on the original four-category taxonomy.Both automatic and qualitative evaluations show that the fine-grained model produces more pedagogically aligned and effective responses.Our findings highlight the value of intent specificity for controlled text generation in educational settings, and we release our annotated data and code to facilitate further research:

Artificial Intelligence in Medicine (Canada) (CA)
Quality Education
Openalex Percentile: Top 90%
Intelligent Tutoring Systems and Adaptive Learning
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Intent Matters: Enhancing AI Tutoring with Fine-Grained Pedagogical Intent Annotation — Ekaterina Kochmar, Kseniia Petukhova · (2025) | TGRS Research Map | TGRS