Examining peer review network dynamics in higher education visual communication courses using ERGM

• Visual rubric attributes drive peer connections via Exponential random graph models. • Students’ class performance do not impact peer connections. • Language used in review feedback affects peer ties. • Student peer review dynamics exhibit a social network-like behavior. • Future research will explore higher-order structures for deeper insights into peer dynamics. Peer review plays a pivotal role in shaping collaborative learning environments and evaluating student engagement, but there is a lack of research on the relational dynamics that underlie the interactions between students during the peer review process, which is critical for understanding the effectiveness of peer review for students’ learning outcomes. Using explanatory sequential study design, this study’s objectives are to explore the dynamics of peer review as a feedback mechanism in higher education within a social network context, focusing on student interactions during the feedback process. Specifically, we applied dyadic-independent Exponential Random Graph Modeling (ERGM), along with mixed-methods design to analyze peer review interactions within a visual communication course at a large state university. We collected and analyzed two samples: a quantitative sample of 167 students for network analysis, drawn from 3082 peer reviews and rubric scores, and a qualitative sample of 136 students from post-course surveys that provided feedback on the peer review process and course methodologies. Our investigation revealed the inherently social network nature of peer review, shedding light on its significance in engaging students and assessing student engagement. Specifically, we examined the role of students’ performance levels, edge-based attributes derived from the visual peer review rubric, and language used in the feedback on the likelihood of forming peer review connections in the network. Our findings indicate that attributes derived from the visual peer review rubric significantly influence the likelihood of peer connections. On the other hand, students’ performance levels do not have any impact on the formation of peer connections. The findings highlight the importance of visual peer review activities in shaping peer connections in the classroom. Future studies will incorporate higher-order structures, such as transitivity and triadic closure, into our ERGM model to further enhance our understanding of peer review dynamics in educational settings.

Authors

Institutions

Publication Details

Journal
Computers and Education Open
Published
2024-09-30
DOI
https://doi.org/10.1016/j.caeo.2024.100222
Citations
2
Primary Topic
Evaluation of Teaching Practices
Type
article
Field-Weighted Citation Impact
4.19

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Examining peer review network dynamics in higher education visual communication courses using ERGM

Alon Friedman, Ly Dinh, Kevin Hawley
2 citations
Computers and Education Open
Evaluation of Teaching Practices
4.19
article

Examining peer review network dynamics in higher education visual communication courses using ERGM

Alon Friedman, Ly Dinh, Kevin Hawley
article en
2 citations

Abstract

• Visual rubric attributes drive peer connections via Exponential random graph models. • Students’ class performance do not impact peer connections. • Language used in review feedback affects peer ties. • Student peer review dynamics exhibit a social network-like behavior. • Future research will explore higher-order structures for deeper insights into peer dynamics. Peer review plays a pivotal role in shaping collaborative learning environments and evaluating student engagement, but there is a lack of research on the relational dynamics that underlie the interactions between students during the peer review process, which is critical for understanding the effectiveness of peer review for students’ learning outcomes. Using explanatory sequential study design, this study’s objectives are to explore the dynamics of peer review as a feedback mechanism in higher education within a social network context, focusing on student interactions during the feedback process. Specifically, we applied dyadic-independent Exponential Random Graph Modeling (ERGM), along with mixed-methods design to analyze peer review interactions within a visual communication course at a large state university. We collected and analyzed two samples: a quantitative sample of 167 students for network analysis, drawn from 3082 peer reviews and rubric scores, and a qualitative sample of 136 students from post-course surveys that provided feedback on the peer review process and course methodologies. Our investigation revealed the inherently social network nature of peer review, shedding light on its significance in engaging students and assessing student engagement. Specifically, we examined the role of students’ performance levels, edge-based attributes derived from the visual peer review rubric, and language used in the feedback on the likelihood of forming peer review connections in the network. Our findings indicate that attributes derived from the visual peer review rubric significantly influence the likelihood of peer connections. On the other hand, students’ performance levels do not have any impact on the formation of peer connections. The findings highlight the importance of visual peer review activities in shaping peer connections in the classroom. Future studies will incorporate higher-order structures, such as transitivity and triadic closure, into our ERGM model to further enhance our understanding of peer review dynamics in educational settings.

Computers and Education OpenVol. 7
University of South Florida (US)
Division of Undergraduate Education
Quality Education
Openalex Percentile: Top 6%
Evaluation of Teaching Practices
4.19
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.