Does testing environment matter for virtual school students?

• Students in virtual schools perform better on tests when allowed to test from home. • At-home testing enhances the concurrent validity of tests. • Evidence is inconclusive as to whether better outcomes are explained by cheating. Standardized test performance among students in full-time virtual schools generally lags behind that of students in traditional, face-to-face schools. One largely unexplored potential cause is the requirement to complete tests at unfamiliar facilities rather than from home, the normal learning environment for these students. The COVID-19 pandemic enabled some full-time virtual school students to test from home, providing a unique opportunity to assess how testing environment might influence outcomes. Using data from an educational management organization (EMO) running virtual schools in 21 U.S. states, we test whether full-time virtual school students perform better on standardized exams administered at home ( n = 524) relative to those testing at an unfamiliar testing site ( n = 1,443) in 2020–21. Home testing is associated with nearly one fifth of a standard deviation improvement in math and ELA performance even after controlling for prior test performance. Moreover, tests taken from home more strongly correlate with other measures of academic performance than do tests taken at designated facilities, indicating they better capture academic progress. Analyses investigating whether home testing enables cheating are inconclusive.

Authors

Institutions

Publication Details

Journal
Computers and Education Open
Published
2024-11-12
DOI
https://doi.org/10.1016/j.caeo.2024.100232
Citations
2
Primary Topic
Online and Blended Learning
Type
article
Field-Weighted Citation Impact
4.19
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Does testing environment matter for virtual school students?

Ian Kingsbury, Robert Maranto, Andrea Honeycutt
2 citations
Computers and Education Open
Online and Blended Learning
4.19
article

Does testing environment matter for virtual school students?

Ian Kingsbury, Robert Maranto, Andrea Honeycutt
article en
2 citations

Abstract

• Students in virtual schools perform better on tests when allowed to test from home. • At-home testing enhances the concurrent validity of tests. • Evidence is inconclusive as to whether better outcomes are explained by cheating. Standardized test performance among students in full-time virtual schools generally lags behind that of students in traditional, face-to-face schools. One largely unexplored potential cause is the requirement to complete tests at unfamiliar facilities rather than from home, the normal learning environment for these students. The COVID-19 pandemic enabled some full-time virtual school students to test from home, providing a unique opportunity to assess how testing environment might influence outcomes. Using data from an educational management organization (EMO) running virtual schools in 21 U.S. states, we test whether full-time virtual school students perform better on standardized exams administered at home ( n = 524) relative to those testing at an unfamiliar testing site ( n = 1,443) in 2020–21. Home testing is associated with nearly one fifth of a standard deviation improvement in math and ELA performance even after controlling for prior test performance. Moreover, tests taken from home more strongly correlate with other measures of academic performance than do tests taken at designated facilities, indicating they better capture academic progress. Analyses investigating whether home testing enables cheating are inconclusive.

Computers and Education OpenVol. 7
Arkansas Department of Education (US), Freedom House (US)
Climate action
Openalex Percentile: Top 5%
Online and Blended Learning
4.19
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Does testing environment matter for virtual school students? — Ian Kingsbury, Robert Maranto, et al. · Computers and Education Open (2024) | TGRS Research Map | TGRS