Perception and Usability Evaluation of an English for Engineering E-Book in the Road Transportation System Engineering Study Program
English for Engineering (EFE) materials must be both contextually relevant and easy to use. This study evaluated cadets’ perceptions of the usability of an EFE e-book (version 1.0) that had been developed from a needs analysis, after it was used in eight learning sessions in the Road Transportation System Engineering (RSTJ) study program of Politeknik Keselamatan Transportasi Jalan, Tegal, Indonesia. A quantitative descriptive design was applied. Data were collected from 105 third-semester cadets (88.2% of the population of 119) using the ten-item System Usability Scale (SUS) and a short questionnaire on respondent characteristics. The data were analyzed with descriptive statistics, a one-sample t-test against the benchmark of 68, item-level analysis, and the Learnable and Usable subscales of the SUS. The mean SUS score was 82.4 (SD = 6.9; 95% CI [81.1, 83.7]), which falls in the “Excellent” band of the working categories adopted in this study (80–100) and is above the benchmark of 68, t(104) = 21.26, p < .001, d = 2.08 (the large d partly reflects the narrow spread of scores). All 105 cadets scored 68 or higher: 73.3% scored in the Excellent band and 26.7% in the Good band. The strongest items concerned low complexity, ease of use, and the absence of cumbersome operation, whereas the weakest items concerned the need to learn many things before starting (Q10) and the need for technical support (Q4). Descriptively and tentatively, the Learnable subscale (75.1) was lower than the Usable subscale (84.2), although this two-factor split is of uncertain stability and the Learnable subscale has only two items. Internal consistency of the SUS in this restricted-range sample was low (α = 0.41) and all scores lay between 70.0 and 92.5. The survey was completed in class by cadets taught by the lecturers who developed the e-book, so social desirability may have inflated the ratings. In this cohort, as rated in a post-use survey, the e-book was perceived very favorably. The findings suggest that onboarding and embedded help are the relative priorities for version 2.0, a conclusion that rests on neutral rather than unfavorable answers and needs confirmation with qualitative evidence.
Authors
- Dani Fitria Brilianti
- Aat Eska Fahmadi (ORCID: https://orcid.org/0009-0004-3546-7185)
- Abdul Rokhim (ORCID: https://orcid.org/0000-0001-5845-0766)
- Nurul Fitriani
Publication Details
- Journal
- Academic Journal Perspective Education Language and Literature
- Published
- 2026-11-14
- DOI
- https://doi.org/10.33603/perspective.v14i2.13015
- Primary Topic
- English Language Learning and Teaching
- Type
- article
- Field-Weighted Citation Impact
- 0.00