Perception and Usability Evaluation of an English for Engineering E-Book in the Road Transportation System Engineering Study Program

English for Engineering (EFE) materials must be both contextually relevant and easy to use. This study evaluated cadets’ perceptions of the usability of an EFE e-book (version 1.0) that had been developed from a needs analysis, after it was used in eight learning sessions in the Road Transportation System Engineering (RSTJ) study program of Politeknik Keselamatan Transportasi Jalan, Tegal, Indonesia. A quantitative descriptive design was applied. Data were collected from 105 third-semester cadets (88.2% of the population of 119) using the ten-item System Usability Scale (SUS) and a short questionnaire on respondent characteristics. The data were analyzed with descriptive statistics, a one-sample t-test against the benchmark of 68, item-level analysis, and the Learnable and Usable subscales of the SUS. The mean SUS score was 82.4 (SD = 6.9; 95% CI [81.1, 83.7]), which falls in the “Excellent” band of the working categories adopted in this study (80–100) and is above the benchmark of 68, t(104) = 21.26, p < .001, d = 2.08 (the large d partly reflects the narrow spread of scores). All 105 cadets scored 68 or higher: 73.3% scored in the Excellent band and 26.7% in the Good band. The strongest items concerned low complexity, ease of use, and the absence of cumbersome operation, whereas the weakest items concerned the need to learn many things before starting (Q10) and the need for technical support (Q4). Descriptively and tentatively, the Learnable subscale (75.1) was lower than the Usable subscale (84.2), although this two-factor split is of uncertain stability and the Learnable subscale has only two items. Internal consistency of the SUS in this restricted-range sample was low (α = 0.41) and all scores lay between 70.0 and 92.5. The survey was completed in class by cadets taught by the lecturers who developed the e-book, so social desirability may have inflated the ratings. In this cohort, as rated in a post-use survey, the e-book was perceived very favorably. The findings suggest that onboarding and embedded help are the relative priorities for version 2.0, a conclusion that rests on neutral rather than unfavorable answers and needs confirmation with qualitative evidence.

Authors

Publication Details

Journal
Academic Journal Perspective Education Language and Literature
Published
2026-11-14
DOI
https://doi.org/10.33603/perspective.v14i2.13015
Primary Topic
English Language Learning and Teaching
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Perception and Usability Evaluation of an English for Engineering E-Book in the Road Transportation System Engineering Study Program

Dani Fitria Brilianti, Aat Eska Fahmadi, Abdul Rokhim, Nurul Fitriani
Academic Journal Perspective Education Language and Literature
English Language Learning and Teaching
article

Perception and Usability Evaluation of an English for Engineering E-Book in the Road Transportation System Engineering Study Program

Dani Fitria Brilianti, Aat Eska Fahmadi, Abdul Rokhim, Nurul Fitriani
article en

Abstract

English for Engineering (EFE) materials must be both contextually relevant and easy to use. This study evaluated cadets’ perceptions of the usability of an EFE e-book (version 1.0) that had been developed from a needs analysis, after it was used in eight learning sessions in the Road Transportation System Engineering (RSTJ) study program of Politeknik Keselamatan Transportasi Jalan, Tegal, Indonesia. A quantitative descriptive design was applied. Data were collected from 105 third-semester cadets (88.2% of the population of 119) using the ten-item System Usability Scale (SUS) and a short questionnaire on respondent characteristics. The data were analyzed with descriptive statistics, a one-sample t-test against the benchmark of 68, item-level analysis, and the Learnable and Usable subscales of the SUS. The mean SUS score was 82.4 (SD = 6.9; 95% CI [81.1, 83.7]), which falls in the “Excellent” band of the working categories adopted in this study (80–100) and is above the benchmark of 68, t(104) = 21.26, p < .001, d = 2.08 (the large d partly reflects the narrow spread of scores). All 105 cadets scored 68 or higher: 73.3% scored in the Excellent band and 26.7% in the Good band. The strongest items concerned low complexity, ease of use, and the absence of cumbersome operation, whereas the weakest items concerned the need to learn many things before starting (Q10) and the need for technical support (Q4). Descriptively and tentatively, the Learnable subscale (75.1) was lower than the Usable subscale (84.2), although this two-factor split is of uncertain stability and the Learnable subscale has only two items. Internal consistency of the SUS in this restricted-range sample was low (α = 0.41) and all scores lay between 70.0 and 92.5. The survey was completed in class by cadets taught by the lecturers who developed the e-book, so social desirability may have inflated the ratings. In this cohort, as rated in a post-use survey, the e-book was perceived very favorably. The findings suggest that onboarding and embedded help are the relative priorities for version 2.0, a conclusion that rests on neutral rather than unfavorable answers and needs confirmation with qualitative evidence.

Academic Journal Perspective Education Language and LiteratureVol. 14(2)
English Language Learning and Teaching
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon