Technological revolution in evaluation: Artificial intelligence and the adherence to evaluation standards

In the advent of revolutionary technological change, perpetuated by the publishing of Large Language Models like ChatGPT, the article discusses the transformative effects of artificial intelligence on the application of evaluation standards. Amid a debate on the integration of artificial intelligence technology in evaluation processes, there is a lack of understanding about how artificial intelligence usage impacts adherence to these standards. This article endeavors to bridge this gap by examining the future trends of the ongoing technological revolution, assessing the potential for evaluation tasks to be augmented or replaced by artificial intelligence systems and conducting a thorough opportunity and risk analysis regarding the adherence to evaluation standards. The article addresses both opportunities, such as increased efficiency and analytical depth, and challenges, including structural errors and biases. It concludes with suggestions for evaluators, emphasizing the balance between leveraging artificial intelligence’s capabilities and maintaining critical oversight and ethical responsibility in evaluation practices.

Authors

Institutions

Publication Details

Journal
Evaluation
Published
2025-06-13
DOI
https://doi.org/10.1177/13563890251331066
Citations
1
Primary Topic
Artificial Intelligence in Healthcare and Education
Type
article
Field-Weighted Citation Impact
0.65
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Technological revolution in evaluation: Artificial intelligence and the adherence to evaluation standards

Kai Rompczyk
1 citations
Evaluation
Artificial Intelligence in Healthcare and Education
0.65
article

Technological revolution in evaluation: Artificial intelligence and the adherence to evaluation standards

Kai Rompczyk
article en
1 citations

Abstract

In the advent of revolutionary technological change, perpetuated by the publishing of Large Language Models like ChatGPT, the article discusses the transformative effects of artificial intelligence on the application of evaluation standards. Amid a debate on the integration of artificial intelligence technology in evaluation processes, there is a lack of understanding about how artificial intelligence usage impacts adherence to these standards. This article endeavors to bridge this gap by examining the future trends of the ongoing technological revolution, assessing the potential for evaluation tasks to be augmented or replaced by artificial intelligence systems and conducting a thorough opportunity and risk analysis regarding the adherence to evaluation standards. The article addresses both opportunities, such as increased efficiency and analytical depth, and challenges, including structural errors and biases. It concludes with suggestions for evaluators, emphasizing the balance between leveraging artificial intelligence’s capabilities and maintaining critical oversight and ethical responsibility in evaluation practices.

EvaluationVol. 31(3)
German Institute of Development and Sustainability (DE), DEval – Deutsches Evaluierungsinstitut der Entwicklungszusammenarbeit
Openalex Percentile: Top 24%
Artificial Intelligence in Healthcare and Education
0.65
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.