Construct Validity and Dimensionality Analysis of the TOEIC Listening and Reading Test in English for Aviation Using the Rasch Model
English proficiency is an essential competence for aviation cadets because it supports academic learning, technical training, and communication in aviation-related contexts. This study aims to analyze the construct validity and dimensional structure of the TOEIC Listening and Reading test in the context of English for Aviation using the Rasch Model. This study employed a quantitative psychometric validation design involving 100 cadets of one of the Polytechnic at Surabaya, Indonesia. The instrument consisted of 200 dichotomous TOEIC Listening and Reading items, with 100 items representing the Listening section and 100 items representing the Reading section. Data were analyzed using the Rasch Model through the R programming language with the TAM package. The analysis included data cleaning, extreme item detection, item difficulty estimation, person ability estimation, item fit analysis, WLE reliability, and dimensionality analysis by comparing one-dimensional and two-dimensional Rasch models. The results showed that the final dataset consisted of 100 respondents and 200 items, with no extreme items detected. The WLE reliability value was 0.971, indicating highly consistent estimation of cadets’ English ability. The dimensionality analysis showed that the one-dimensional model had lower AIC and BIC values than the two-dimensional model, suggesting that TOEIC Listening and Reading in this sample is better represented as one general English proficiency construct rather than two fully separate Listening and Reading dimensions. These findings provide empirical evidence that TOEIC Listening and Reading can support meaningful score interpretation as a general indicator of English proficiency for aviation cadets, although aviation-specific language assessment tasks are recommended to complement TOEIC scores when operational communication ability needs to be assessed more directly.
Authors
- Lady Silk Moonlight (ORCID: https://orcid.org/0000-0002-1285-7074)
- Laila Rochmawati (ORCID: https://orcid.org/0000-0001-5502-6070)
- Ahmad Rossydi (ORCID: https://orcid.org/0000-0002-0946-6646)
- Meita Maharani Sukma (ORCID: https://orcid.org/0000-0003-3546-7420)
- Fatmawati Fatmawati (ORCID: https://orcid.org/0000-0001-7757-3745)
- Dewi Ratna Sari
Publication Details
- Journal
- Jurnal Pembelajaran Bimbingan dan Pengelolaan Pendidikan
- Published
- 2026-10-29
- DOI
- https://doi.org/10.17977/um065.v7.i5.2027.3
- Primary Topic
- Psychometric Methodologies and Testing
- Type
- article
- Field-Weighted Citation Impact
- 0.00