Evaluating Note-Taking Modes in Second Language Listening Assessment: Measurement Invariance Between Handwriting and Typing
This paper examined whether an L2 listening test maintained measurement and structural invariance (whether the test measured listening ability and represented its underlying structure comparably) between handwriting and typing note-taking modes. A total of 204 Korean adults, primarily university students, were randomly assigned to handwriting or typing conditions and completed four TOEFL iBT lecture-based listening comprehension tasks with multiple-choice questions. To test measurement and structural invariance, multigroup confirmatory factor analysis was conducted. Partial metric invariance (comparable relationships between individual items and listening ability) was supported after allowing three items to differ in how strongly they reflected listening ability between the two groups. Partial scalar invariance (comparable item score levels between groups) was supported after allowing two items to have different expected scores between the two groups. The final strict and structural invariance models showed good fit, supporting equivalence in residual variances and latent means between the two groups. Overall, handwriting and typing did not substantially alter the construct measured by the test, although several items functioned differently between the two groups. These findings suggest that neither modalities of note-taking systematically disadvantages test takers, underscoring the importance of validating note-taking policies in high-stakes assessments to ensure fairness between the two modes.
Authors
- Seongah Im (ORCID: https://orcid.org/0000-0001-8447-6484)
- Jieun Kim (ORCID: https://orcid.org/0000-0001-5924-370X)
Institutions
- University of Hawaiʻi at Mānoa (US)
- Soongsil University (KR)
Publication Details
- Journal
- Language Assessment Quarterly
- Published
- 2026-11-18
- DOI
- https://doi.org/10.1080/15434303.2026.2765925
- Primary Topic
- Psychometric Methodologies and Testing
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- International Research Foundation for English Language Education