TRATES: Trait-Specific Rubric-Assisted Cross-Prompt Essay Scoring
Research on holistic Automated Essay Scoring (AES) is long-dated; yet, there is a notable lack of attention for assessing essays according to individual traits.In this work, we propose TRATES, a novel trait-specific and rubricbased cross-prompt AES framework that is generic yet specific to the underlying trait.The framework leverages a Large Language Model (LLM) that utilizes the trait grading rubrics to generate trait-specific features (represented by assessment questions), then assesses those features given an essay.The trait-specific features are eventually combined with generic writingquality and prompt-specific features to train a simple classical regression model that predicts trait scores of essays from an unseen prompt.Experiments show that TRATES achieves a new state-of-the-art performance across all traits on a widely-used dataset, with the generated LLMbased features being the most significant.
Authors
- Sohaila Eltanbouly (ORCID: https://orcid.org/0000-0002-4917-5851)
- Tamer Elsayed (ORCID: https://orcid.org/0000-0001-5786-4668)
- Salam Albatarni (ORCID: https://orcid.org/0000-0002-8780-3740)
Institutions
- Qatar University (QA)
Publication Details
- Published
- 2025-01-01
- DOI
- https://doi.org/10.18653/v1/2025.findings-acl.1054
- Primary Topic
- Model-Driven Software Engineering Techniques
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- Qatar Foundation
- Fonds National de la Recherche Luxembourg
- Qatar National Research Fund