Contribution to Teaching Analytics: Measuring Teachers' Digital Maturity With Large‐Scale <scp>VLE</scp> Logs Dataset

ABSTRACT Background This research employs the concept of digital maturity (DM) to characterise levels of digital use in education and to represent them on a dashboard. This dashboard should enable assessment of teachers' digital practices and tracking of their technology adoption over time, particularly when new continuing professional development opportunities are offered to support their integration of digital tools into their professional practice. The challenge of this research is to make these observations at scale and in a regular manner. This study explores the use of Teaching Analytics to measure and report on teachers' DM. Objectives The paper proposes methods for processing and analysing teachers' virtual learning environment (VLE) activity logs to characterise DM. Specifically, the focus is on identifying analytical methods for modelling and assessing maturity, as well as visualising population states to help stakeholders better understand and use these data. Methods The techniques employed include structuring data according to the DigCompEdu competence framework, supervised and unsupervised classification to assess maturity levels across dimensions (diversity, intensity, and type of usage), and three visualisations (Sunburst, Histogram, and Bubble chart) integrated into a dashboard. These three visualisations were evaluated (usability and satisfaction, perceived credibility, perceived usefulness, and actionability) during interviews with stakeholders. A discussion also addresses interactive methods for presenting these results through a dashboard. The methods are illustrated using increasingly large datasets representing 12,949 teachers (Paris, 2022–2023), 144,900 teachers (Paris, Lille, Amiens, 2022–2024), and 1,320,000 teachers (national area, 2022–2026). Results and Conclusions This study makes three contributions. First, it proposes an operational framework for designing a multidimensional dashboard that uses VLE logs to assess teachers' DM at scale. It uses supervised and unsupervised classification and considers the intensity of use (frequency) of the VLE platform by teachers, as well as the diversity and types of use. Second, it compares supervised and unsupervised classification approaches to examine their scalability and analytical accuracy. Third, it explores how different institutional actors perceive dashboards, focusing on their interpretability, credibility, and practical usefulness.

Authors

Institutions

Publication Details

Journal
Journal of Computer Assisted Learning
Published
2026-04-26
DOI
https://doi.org/10.1002/jcal.70253
Primary Topic
Online Learning and Analytics
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Contribution to Teaching Analytics: Measuring Teachers' Digital Maturity With Large‐Scale VLE Logs Dataset

Laëtitia Pierrot, Olivier Vigneau, Christine Michel, Frédéric Oru
Journal of Computer Assisted Learning
Online Learning and Analytics
article

Contribution to Teaching Analytics: Measuring Teachers' Digital Maturity With Large‐Scale VLE Logs Dataset

Laëtitia Pierrot, Olivier Vigneau, Christine Michel, Frédéric Oru
article en

Abstract

ABSTRACT Background This research employs the concept of digital maturity (DM) to characterise levels of digital use in education and to represent them on a dashboard. This dashboard should enable assessment of teachers' digital practices and tracking of their technology adoption over time, particularly when new continuing professional development opportunities are offered to support their integration of digital tools into their professional practice. The challenge of this research is to make these observations at scale and in a regular manner. This study explores the use of Teaching Analytics to measure and report on teachers' DM. Objectives The paper proposes methods for processing and analysing teachers' virtual learning environment (VLE) activity logs to characterise DM. Specifically, the focus is on identifying analytical methods for modelling and assessing maturity, as well as visualising population states to help stakeholders better understand and use these data. Methods The techniques employed include structuring data according to the DigCompEdu competence framework, supervised and unsupervised classification to assess maturity levels across dimensions (diversity, intensity, and type of usage), and three visualisations (Sunburst, Histogram, and Bubble chart) integrated into a dashboard. These three visualisations were evaluated (usability and satisfaction, perceived credibility, perceived usefulness, and actionability) during interviews with stakeholders. A discussion also addresses interactive methods for presenting these results through a dashboard. The methods are illustrated using increasingly large datasets representing 12,949 teachers (Paris, 2022–2023), 144,900 teachers (Paris, Lille, Amiens, 2022–2024), and 1,320,000 teachers (national area, 2022–2026). Results and Conclusions This study makes three contributions. First, it proposes an operational framework for designing a multidimensional dashboard that uses VLE logs to assess teachers' DM at scale. It uses supervised and unsupervised classification and considers the intensity of use (frequency) of the VLE platform by teachers, as well as the diversity and types of use. Second, it compares supervised and unsupervised classification approaches to examine their scalability and analytical accuracy. Third, it explores how different institutional actors perceive dashboards, focusing on their interpretability, credibility, and practical usefulness.

Journal of Computer Assisted LearningVol. 42(3)
Université de Poitiers (FR), Centre Hospitalier du Mans (FR), Da Volterra (France) (FR), Électricité de France (France) (FR)
Quality Education
Openalex Percentile: Top 11%
Online Learning and Analytics
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.