Defining Log Data Indicators for the Measurement of Generic Critical Online Reasoning (GEN-COR)

Background: For higher education students, the Internet has become the most important source of information. Because of the vast amount of misleading or biased information on the Internet, it poses challenges students need specific skills for, which are described by Critical Online Reasoning (COR). Other studies on comparable literacy constructs employed closed information spaces and simulated online environments.Objectives: We identify log data indicators for one of COR’s facets, Online Information Acquisition (OIA), and accumulate them into a factor structure using an open online environment.Methods: 566 first-year students of three German universities logged into a virtual machine and completed a questionnaire consisting of tasks requiring an online search. Through logging their search behaviour, we extracted log events and combined them into indicators for OIA based on literature as well as our own developments. We then employed factor analysis to find their underlying structure.Results and Conclusions: We identified ten log data indicators for OIA, of which six could be accumulated into a factor structure. Despite our initial assumption of a single underlying factor, we found two factors for OIA, one concerning search term formulation and the other concerning behaviour on the search engine results page. This expands our knowledge about OIA and COR and shows the feasibility of using log data indicators for digital literacy research.

Authors

Publication Details

Journal
PsyArXiv (OSF Preprints)
Published
2026-11-19
DOI
https://doi.org/10.31234/osf.io/fr5d9
Primary Topic
Library Science and Information Literacy
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
preprint

Defining Log Data Indicators for the Measurement of Generic Critical Online Reasoning (GEN-COR)

Carolin Hahnel, Johannes Hartig, Daniel Baumartz, Frank Goldhammer et al.
PsyArXiv (OSF Preprints)
Library Science and Information Literacy
preprint

Defining Log Data Indicators for the Measurement of Generic Critical Online Reasoning (GEN-COR)

Carolin Hahnel, Johannes Hartig, Daniel Baumartz, Frank Goldhammer, Carmen Köhler, Philine Drake, Marcus Schrickel, Jannick Illmann
preprint en

Abstract

Background: For higher education students, the Internet has become the most important source of information. Because of the vast amount of misleading or biased information on the Internet, it poses challenges students need specific skills for, which are described by Critical Online Reasoning (COR). Other studies on comparable literacy constructs employed closed information spaces and simulated online environments.Objectives: We identify log data indicators for one of COR’s facets, Online Information Acquisition (OIA), and accumulate them into a factor structure using an open online environment.Methods: 566 first-year students of three German universities logged into a virtual machine and completed a questionnaire consisting of tasks requiring an online search. Through logging their search behaviour, we extracted log events and combined them into indicators for OIA based on literature as well as our own developments. We then employed factor analysis to find their underlying structure.Results and Conclusions: We identified ten log data indicators for OIA, of which six could be accumulated into a factor structure. Despite our initial assumption of a single underlying factor, we found two factors for OIA, one concerning search term formulation and the other concerning behaviour on the search engine results page. This expands our knowledge about OIA and COR and shows the feasibility of using log data indicators for digital literacy research.

PsyArXiv (OSF Preprints)
Library Science and Information Literacy
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon