Quantifying Student Success with Generative AI: A Monte Carlo Simulation Informed by Systematic Review

Abstract—The rapid rise of generative AI (GenAI) tools, such as ChatGPT, has intensified interest in their role in higher education and how students perceive and use them. This study combines a PRISMA-guided literature review with simulation-based modelling to examine student perceptions of GenAI. Nineteen empirical articles (2023–2025) were identified in Scopus; six reported item-level means and standard deviations suitable for probabilistic modelling. From this subset, one well-structured Likert dataset is selected as a canonical example to parameterise an inverse-variance-weighted Monte Carlo simulation, yielding a composite, perception-based “Success Score” (self-evaluated success). The simulation characterises both point estimates and uncertainty in this score under different thematic configurations. Within the simulated usability-derived themes, System Efficiency & Learning Burden receives the largest inverse-variance weight (highest precision) and therefore has the greatest influence on the composite perception-based Success Score under this weighting scheme. The approach provides a transparent and privacy-preserving bridge between thematic synthesis and probabilistic modelling for future work, linking GenAI perceptions to educational outcomes. Keywords—generative AI, Monte Carlo simulation, student success, usability, higher education

Authors

Publication Details

Journal
ArXiv.org
Published
2025-06-30
DOI
https://doi.org/10.25397/ppny-f488
Primary Topic
Online Learning and Analytics
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Quantifying Student Success with Generative AI: A Monte Carlo Simulation Informed by Systematic Review

Seyma Yaman Kayadibi
ArXiv.org
Online Learning and Analytics
article

Quantifying Student Success with Generative AI: A Monte Carlo Simulation Informed by Systematic Review

Seyma Yaman Kayadibi
article en

Abstract

Abstract—The rapid rise of generative AI (GenAI) tools, such as ChatGPT, has intensified interest in their role in higher education and how students perceive and use them. This study combines a PRISMA-guided literature review with simulation-based modelling to examine student perceptions of GenAI. Nineteen empirical articles (2023–2025) were identified in Scopus; six reported item-level means and standard deviations suitable for probabilistic modelling. From this subset, one well-structured Likert dataset is selected as a canonical example to parameterise an inverse-variance-weighted Monte Carlo simulation, yielding a composite, perception-based “Success Score” (self-evaluated success). The simulation characterises both point estimates and uncertainty in this score under different thematic configurations. Within the simulated usability-derived themes, System Efficiency & Learning Burden receives the largest inverse-variance weight (highest precision) and therefore has the greatest influence on the composite perception-based Success Score under this weighting scheme. The approach provides a transparent and privacy-preserving bridge between thematic synthesis and probabilistic modelling for future work, linking GenAI perceptions to educational outcomes. Keywords—generative AI, Monte Carlo simulation, student success, usability, higher education

ArXiv.org
Openalex Percentile: Top 70%
Online Learning and Analytics
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Quantifying Student Success with Generative AI: A Monte Carlo Simulation Informed by Systematic Review — Seyma Yaman Kayadibi · ArXiv.org (2025) | TGRS Research Map | TGRS