Measuring teacher assessment literacy in digital environments: Development and validation of a scenario-based instrument

The significance of teacher’s assessment literacy (AL) was originally captured by the 1990 standards for teacher’s competence in educational assessment. Competence in assessment has changed with the widespread use of recent technology advancements in educational assessment. Consequently, new measures are needed to measure Teacher Assessment Literacy in Digital Environments (TALiDE). A new multidimensional, bifactor, scenario-based self-report inventory was developed with expert review (i.e., face and content validation) and confirmatory factor analysis based on responses from teachers who use digital assessments. The TALiDE questionnaire identifies five roles that summarize teacher competence domains (i.e., Judge, Communicator, Moral Agent, Knower, and Technologist) and the five aspects of each role (i.e., attitude, agency, resources, training needs, and actual practices). Means across the five roles were similar (range 3.46-3.63) but attitudes were notably more positive than actual practice (3.84 vs. 3.17, respectively). The TALiDE scale can help reveal teacher professional development requirements when being asked to use digital assessments educationally. It also makes clear the complex roles and facets of teacher assessment literacy that need to be addressed in teacher education and professional development.