Artificial Intelligence from Google Environment for Effective Learning Assessment

This study investigates the use of Google NotebookLM for the automatic generation of educational assessment items. A mixed-methods approach was adopted, combining quantitative psychometric evaluation with qualitative student feedback. Six tests, each composed of 15 multiple-choice questions generated from diverse sources such as PDFs, web slides, and YouTube videos, were administered to undergraduate students. Quantitative analysis involved calculating key indices which confirmed that many AI-generated items met acceptable psychometric criteria, though some items revealed reliability concerns and potential bias. Concurrently, a structured questionnaire assessed the clarity, relevance, and fairness of the test items. Students generally rated the AI-generated questions positively in terms of clarity and pedagogical alignment, while also noting areas for improvement. In conclusion, the findings suggest that generative AI can offer a scalable and efficient solution for test item creation; however, further methodological refinements are needed to ensure consistent validity, reliability, and ethical fairness in learning assessments.

Authors

Institutions

Publication Details

Journal
Information
Published
2025-05-30
DOI
https://doi.org/10.3390/info16060462
Citations
1
Primary Topic
Online Learning and Analytics
Type
article
Field-Weighted Citation Impact
1.69

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Artificial Intelligence from Google Environment for Effective Learning Assessment

Sergio Miranda
1 citations
Information
Online Learning and Analytics
1.69
article

Artificial Intelligence from Google Environment for Effective Learning Assessment

Sergio Miranda
article en
1 citations

Abstract

This study investigates the use of Google NotebookLM for the automatic generation of educational assessment items. A mixed-methods approach was adopted, combining quantitative psychometric evaluation with qualitative student feedback. Six tests, each composed of 15 multiple-choice questions generated from diverse sources such as PDFs, web slides, and YouTube videos, were administered to undergraduate students. Quantitative analysis involved calculating key indices which confirmed that many AI-generated items met acceptable psychometric criteria, though some items revealed reliability concerns and potential bias. Concurrently, a structured questionnaire assessed the clarity, relevance, and fairness of the test items. Students generally rated the AI-generated questions positively in terms of clarity and pedagogical alignment, while also noting areas for improvement. In conclusion, the findings suggest that generative AI can offer a scalable and efficient solution for test item creation; however, further methodological refinements are needed to ensure consistent validity, reliability, and ethical fairness in learning assessments.

InformationVol. 16(6)
University of Salerno (IT)
Università degli Studi di Salerno
Openalex Percentile: Top 13%
Online Learning and Analytics
1.69
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.