Averroes at BEA 2025 Shared Task: Verifying Mistake Identification in Tutor, Student Dialogue
This paper presents the approach and findings of Averroes Team in the BEA 2025 Shared Task Track 1: Mistake Identification.Our system uses the multilingual understanding capabilities of general text embedding models.Our approach involves full-model fine-tuning, where both the pre-trained language model and the classification head are optimized to detect tutor recognition of student mistakes in educational dialogues.This end-to-end training enables the model to better capture subtle pedagogical cues, leading to improved contextual understanding.Evaluated on the official test set, our system achieved an exact macro-F 1 score of 0.7155 and an accuracy of 0.8675, securing third place among the participating teams.These results underline the effectiveness of task-specific optimization in enhancing model sensitivity to error recognition within interactive learning contexts.
Authors
- Mariam Saeed (ORCID: https://orcid.org/0000-0002-0002-3072)
- Ayman Khalafallah
- Mazen Yasser
- Hossam Elkordi
Publication Details
- Published
- 2025-01-01
- DOI
- https://doi.org/10.18653/v1/2025.bea-1.87
- Primary Topic
- Arabic Language Education Studies
- Type
- article
- Field-Weighted Citation Impact
- 0.00