Evaluating Note-Taking Modes in Second Language Listening Assessment: Measurement Invariance Between Handwriting and Typing

This paper examined whether an L2 listening test maintained measurement and structural invariance (whether the test measured listening ability and represented its underlying structure comparably) between handwriting and typing note-taking modes. A total of 204 Korean adults, primarily university students, were randomly assigned to handwriting or typing conditions and completed four TOEFL iBT lecture-based listening comprehension tasks with multiple-choice questions. To test measurement and structural invariance, multigroup confirmatory factor analysis was conducted. Partial metric invariance (comparable relationships between individual items and listening ability) was supported after allowing three items to differ in how strongly they reflected listening ability between the two groups. Partial scalar invariance (comparable item score levels between groups) was supported after allowing two items to have different expected scores between the two groups. The final strict and structural invariance models showed good fit, supporting equivalence in residual variances and latent means between the two groups. Overall, handwriting and typing did not substantially alter the construct measured by the test, although several items functioned differently between the two groups. These findings suggest that neither modalities of note-taking systematically disadvantages test takers, underscoring the importance of validating note-taking policies in high-stakes assessments to ensure fairness between the two modes.

Authors

Institutions

Publication Details

Journal
Language Assessment Quarterly
Published
2026-11-18
DOI
https://doi.org/10.1080/15434303.2026.2765925
Primary Topic
Psychometric Methodologies and Testing
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Evaluating Note-Taking Modes in Second Language Listening Assessment: Measurement Invariance Between Handwriting and Typing

Seongah Im, Jieun Kim
1 links
Language Assessment Quarterly
Psychometric Methodologies and Testing
article

Evaluating Note-Taking Modes in Second Language Listening Assessment: Measurement Invariance Between Handwriting and Typing

Seongah Im, Jieun Kim
article en

Abstract

This paper examined whether an L2 listening test maintained measurement and structural invariance (whether the test measured listening ability and represented its underlying structure comparably) between handwriting and typing note-taking modes. A total of 204 Korean adults, primarily university students, were randomly assigned to handwriting or typing conditions and completed four TOEFL iBT lecture-based listening comprehension tasks with multiple-choice questions. To test measurement and structural invariance, multigroup confirmatory factor analysis was conducted. Partial metric invariance (comparable relationships between individual items and listening ability) was supported after allowing three items to differ in how strongly they reflected listening ability between the two groups. Partial scalar invariance (comparable item score levels between groups) was supported after allowing two items to have different expected scores between the two groups. The final strict and structural invariance models showed good fit, supporting equivalence in residual variances and latent means between the two groups. Overall, handwriting and typing did not substantially alter the construct measured by the test, although several items functioned differently between the two groups. These findings suggest that neither modalities of note-taking systematically disadvantages test takers, underscoring the importance of validating note-taking policies in high-stakes assessments to ensure fairness between the two modes.

Language Assessment Quarterly
University of Hawaiʻi at Mānoa (US), Soongsil University (KR)
International Research Foundation for English Language Education
Psychometric Methodologies and Testing
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon